2026-01-29 03:16:57,341 - INFO - Domain Default found not creating 2026-01-29 03:16:57,513 - INFO - Project ctest-TestSVCV2Mirror-06727449 not found, creating it 2026-01-29 03:16:58,042 - INFO - Created Project:ctest-TestSVCV2Mirror-06727449, ID : abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:16:59,561 - INFO - ================================================================================ 2026-01-29 03:16:59,561 - INFO - STARTING TEST : test_svc_v2_mirroring 2026-01-29 03:16:59,561 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2026-01-29 03:17:00,857 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.193': '0', '10.20.0.254': '0'}, '10.0.0.128': {'10.20.0.254': '0', '10.20.0.14': '0'}} with 2026-01-29 03:17:00,857 - INFO - Initial checks done. Running the testcase now 2026-01-29 03:17:00,857 - INFO - 2026-01-29 03:17:01,564 - DEBUG - Response for create_network : {'network': {'id': '3e758117-cc67-4e74-97f9-7ae0a692f783', 'name': 'ctest-left-80745407', 'tenant_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'project_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-06727449', 'ctest-left-80745407'], 'port_security_enabled': True, 'description': ''}} 2026-01-29 03:17:01,849 - DEBUG - Response for create_subnet : {'subnet': {'id': '1eb4cd45-3ee9-41c9-81d3-8f7bbc84de56', 'name': '', 'tenant_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'network_id': '3e758117-cc67-4e74-97f9-7ae0a692f783', 'ip_version': 4, 'cidr': '157.230.16.192/26', 'allocation_pools': [{'start': '157.230.16.194', 'end': '157.230.16.254'}], 'gateway_ip': '157.230.16.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '157.230.16.194', 'tags': [], 'project_id': 'abf890ecc85243e382c6a5a5b27d8b53'}} 2026-01-29 03:17:01,874 - INFO - Created VN ctest-left-80745407 2026-01-29 03:17:01,887 - DEBUG - VN ctest-left-80745407 UUID is 3e758117-cc67-4e74-97f9-7ae0a692f783 2026-01-29 03:17:01,965 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:17:02,271 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:17:02,304 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:17:02,321 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:17:02,422 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3e758117-cc67-4e74-97f9-7ae0a692f783 2026-01-29 03:17:02,444 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3e758117-cc67-4e74-97f9-7ae0a692f783 2026-01-29 03:17:02,458 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/65b610bc-dcea-4643-b4bc-bc58c0ad0913 2026-01-29 03:17:02,469 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/65b610bc-dcea-4643-b4bc-bc58c0ad0913 2026-01-29 03:17:02,478 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/333f41fd-fa55-4610-be90-15d7b79d35a2 2026-01-29 03:17:02,486 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-01-29 03:17:02,486 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3e758117-cc67-4e74-97f9-7ae0a692f783 2026-01-29 03:17:02,496 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/65b610bc-dcea-4643-b4bc-bc58c0ad0913 2026-01-29 03:17:02,513 - INFO - Verified VN network id 13 for VN 3e758117-cc67-4e74-97f9-7ae0a692f783 2026-01-29 03:17:02,513 - INFO - Verifications in API Server for VN ctest-left-80745407 passed 2026-01-29 03:17:02,513 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3e758117-cc67-4e74-97f9-7ae0a692f783 2026-01-29 03:17:02,529 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/65b610bc-dcea-4643-b4bc-bc58c0ad0913 2026-01-29 03:17:02,540 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/65b610bc-dcea-4643-b4bc-bc58c0ad0913 2026-01-29 03:17:02,550 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/333f41fd-fa55-4610-be90-15d7b79d35a2 2026-01-29 03:17:02,564 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4500645341840232052', 'uuid-lslong': '10950919074213984131'}, 'enable': 'true', 'created': '2026-01-29T03:17:01', 'last-modified': '2026-01-29T03:17:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.769915'} 2026-01-29 03:17:02,578 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-01-29 03:17:02,584 - DEBUG - Control-node 10.0.0.147 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4500645341840232052', 'uuid-lslong': '10950919074213984131'}, 'enable': 'true', 'created': '2026-01-29T03:17:01', 'last-modified': '2026-01-29T03:17:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.789239'} 2026-01-29 03:17:02,591 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-01-29 03:17:02,598 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4500645341840232052', 'uuid-lslong': '10950919074213984131'}, 'enable': 'true', 'created': '2026-01-29T03:17:01', 'last-modified': '2026-01-29T03:17:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.799091'} 2026-01-29 03:17:02,607 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-01-29 03:17:02,607 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-80745407 passed 2026-01-29 03:17:02,607 - DEBUG - ====Verifying policy data for ctest-left-80745407 in API_Server ====== 2026-01-29 03:17:02,607 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:17:02,615 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:17:02,627 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:17:02,721 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3e758117-cc67-4e74-97f9-7ae0a692f783 2026-01-29 03:17:02,741 - DEBUG - =>VN ctest-left-80745407 has no policy to be verified 2026-01-29 03:17:02,741 - DEBUG - Verifying the vn in opserver 2026-01-29 03:17:02,741 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407 virtual network link through opserver 10.0.0.23 2026-01-29 03:17:02,741 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-01-29 03:17:03,055 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-01-29 03:17:03,135 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407?flat'} 2026-01-29 03:17:03,135 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407 virtual network link through opserver 10.0.0.147 2026-01-29 03:17:03,135 - DEBUG - Requesting: http://10.0.0.147:8081/analytics/uves/virtual-networks 2026-01-29 03:17:03,434 - DEBUG - Requesting: http://10.0.0.147:8081/analytics/uves/virtual-networks 2026-01-29 03:17:03,495 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407', 'href': 'http://10.0.0.147:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407?flat'} 2026-01-29 03:17:03,495 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407 virtual network link through opserver 10.0.0.240 2026-01-29 03:17:03,496 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-29 03:17:03,795 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-29 03:17:03,881 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407?flat'} 2026-01-29 03:17:03,881 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407 is found in opserver 2026-01-29 03:17:03,910 - DEBUG - Do not have enough data to verify VN in agent 2026-01-29 03:17:03,929 - DEBUG - VRF ids for VN ctest-left-80745407: {} 2026-01-29 03:17:04,225 - DEBUG - Response for create_network : {'network': {'id': '560e1ff0-97ca-454e-a813-44adda3e2aef', 'name': 'ctest-right-79274129', 'tenant_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'project_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-06727449', 'ctest-right-79274129'], 'port_security_enabled': True, 'description': ''}} 2026-01-29 03:17:04,517 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cc705ff6-e53d-45f6-972f-c53a8c849126', 'name': '', 'tenant_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'network_id': '560e1ff0-97ca-454e-a813-44adda3e2aef', 'ip_version': 4, 'cidr': '52.42.78.192/26', 'allocation_pools': [{'start': '52.42.78.194', 'end': '52.42.78.254'}], 'gateway_ip': '52.42.78.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '52.42.78.194', 'tags': [], 'project_id': 'abf890ecc85243e382c6a5a5b27d8b53'}} 2026-01-29 03:17:04,545 - INFO - Created VN ctest-right-79274129 2026-01-29 03:17:04,560 - DEBUG - VN ctest-right-79274129 UUID is 560e1ff0-97ca-454e-a813-44adda3e2aef 2026-01-29 03:17:04,644 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:17:04,650 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:17:04,663 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:17:04,759 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/560e1ff0-97ca-454e-a813-44adda3e2aef 2026-01-29 03:17:04,775 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/560e1ff0-97ca-454e-a813-44adda3e2aef 2026-01-29 03:17:04,786 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d6724554-0d0b-4856-ad87-13a0415eab31 2026-01-29 03:17:04,794 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d6724554-0d0b-4856-ad87-13a0415eab31 2026-01-29 03:17:04,805 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/41080044-4e58-467e-b246-66e3fecd873a 2026-01-29 03:17:04,812 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-01-29 03:17:04,812 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/560e1ff0-97ca-454e-a813-44adda3e2aef 2026-01-29 03:17:04,823 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d6724554-0d0b-4856-ad87-13a0415eab31 2026-01-29 03:17:04,841 - INFO - Verified VN network id 14 for VN 560e1ff0-97ca-454e-a813-44adda3e2aef 2026-01-29 03:17:04,841 - INFO - Verifications in API Server for VN ctest-right-79274129 passed 2026-01-29 03:17:04,841 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/560e1ff0-97ca-454e-a813-44adda3e2aef 2026-01-29 03:17:04,851 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d6724554-0d0b-4856-ad87-13a0415eab31 2026-01-29 03:17:04,859 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d6724554-0d0b-4856-ad87-13a0415eab31 2026-01-29 03:17:04,871 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/41080044-4e58-467e-b246-66e3fecd873a 2026-01-29 03:17:04,895 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6200928855134979406', 'uuid-lslong': '12111099336410933999'}, 'enable': 'true', 'created': '2026-01-29T03:17:04', 'last-modified': '2026-01-29T03:17:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.442808'} 2026-01-29 03:17:04,904 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-01-29 03:17:04,912 - DEBUG - Control-node 10.0.0.147 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6200928855134979406', 'uuid-lslong': '12111099336410933999'}, 'enable': 'true', 'created': '2026-01-29T03:17:04', 'last-modified': '2026-01-29T03:17:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.461143'} 2026-01-29 03:17:04,928 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-01-29 03:17:04,934 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6200928855134979406', 'uuid-lslong': '12111099336410933999'}, 'enable': 'true', 'created': '2026-01-29T03:17:04', 'last-modified': '2026-01-29T03:17:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.482938'} 2026-01-29 03:17:04,945 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-01-29 03:17:04,945 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-79274129 passed 2026-01-29 03:17:04,946 - DEBUG - ====Verifying policy data for ctest-right-79274129 in API_Server ====== 2026-01-29 03:17:04,946 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:17:04,956 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:17:04,976 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:17:05,075 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/560e1ff0-97ca-454e-a813-44adda3e2aef 2026-01-29 03:17:05,092 - DEBUG - =>VN ctest-right-79274129 has no policy to be verified 2026-01-29 03:17:05,092 - DEBUG - Verifying the vn in opserver 2026-01-29 03:17:05,092 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129 virtual network link through opserver 10.0.0.23 2026-01-29 03:17:05,092 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-01-29 03:17:05,156 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129?flat'} 2026-01-29 03:17:05,156 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129 virtual network link through opserver 10.0.0.147 2026-01-29 03:17:05,156 - DEBUG - Requesting: http://10.0.0.147:8081/analytics/uves/virtual-networks 2026-01-29 03:17:05,222 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129', 'href': 'http://10.0.0.147:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129?flat'} 2026-01-29 03:17:05,222 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129 virtual network link through opserver 10.0.0.240 2026-01-29 03:17:05,222 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-29 03:17:05,287 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129?flat'} 2026-01-29 03:17:05,287 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129 is found in opserver 2026-01-29 03:17:05,310 - DEBUG - Do not have enough data to verify VN in agent 2026-01-29 03:17:05,322 - DEBUG - VRF ids for VN ctest-right-79274129: {} 2026-01-29 03:17:05,631 - DEBUG - Response for create_network : {'network': {'id': 'c9420189-1d90-4283-9ffa-c129fd597144', 'name': 'ctest-mgmt_vn-19239895', 'tenant_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'project_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-06727449', 'ctest-mgmt_vn-19239895'], 'port_security_enabled': True, 'description': ''}} 2026-01-29 03:17:05,909 - DEBUG - Response for create_subnet : {'subnet': {'id': '0097e5ce-1434-47ca-a74b-34689ccdfbc5', 'name': '', 'tenant_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'network_id': 'c9420189-1d90-4283-9ffa-c129fd597144', 'ip_version': 4, 'cidr': '117.108.135.0/26', 'allocation_pools': [{'start': '117.108.135.2', 'end': '117.108.135.62'}], 'gateway_ip': '117.108.135.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '117.108.135.2', 'tags': [], 'project_id': 'abf890ecc85243e382c6a5a5b27d8b53'}} 2026-01-29 03:17:05,932 - INFO - Created VN ctest-mgmt_vn-19239895 2026-01-29 03:17:05,952 - DEBUG - VN ctest-mgmt_vn-19239895 UUID is c9420189-1d90-4283-9ffa-c129fd597144 2026-01-29 03:17:06,037 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:17:06,043 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:17:06,059 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:17:06,163 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c9420189-1d90-4283-9ffa-c129fd597144 2026-01-29 03:17:06,178 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c9420189-1d90-4283-9ffa-c129fd597144 2026-01-29 03:17:06,190 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ea746d58-c5df-4927-a6e9-a162d850610e 2026-01-29 03:17:06,198 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ea746d58-c5df-4927-a6e9-a162d850610e 2026-01-29 03:17:06,206 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/2e556372-a124-42b9-ac45-2af2ade52f2b 2026-01-29 03:17:06,214 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-01-29 03:17:06,214 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c9420189-1d90-4283-9ffa-c129fd597144 2026-01-29 03:17:06,228 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ea746d58-c5df-4927-a6e9-a162d850610e 2026-01-29 03:17:06,251 - INFO - Verified VN network id 15 for VN c9420189-1d90-4283-9ffa-c129fd597144 2026-01-29 03:17:06,252 - INFO - Verifications in API Server for VN ctest-mgmt_vn-19239895 passed 2026-01-29 03:17:06,252 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c9420189-1d90-4283-9ffa-c129fd597144 2026-01-29 03:17:06,265 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ea746d58-c5df-4927-a6e9-a162d850610e 2026-01-29 03:17:06,276 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ea746d58-c5df-4927-a6e9-a162d850610e 2026-01-29 03:17:06,286 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/2e556372-a124-42b9-ac45-2af2ade52f2b 2026-01-29 03:17:06,303 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14502155438504559235', 'uuid-lslong': '11527738582296523076'}, 'enable': 'true', 'created': '2026-01-29T03:17:05', 'last-modified': '2026-01-29T03:17:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444695'} 2026-01-29 03:17:06,310 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-01-29 03:17:06,317 - DEBUG - Control-node 10.0.0.147 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14502155438504559235', 'uuid-lslong': '11527738582296523076'}, 'enable': 'true', 'created': '2026-01-29T03:17:05', 'last-modified': '2026-01-29T03:17:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.457181'} 2026-01-29 03:17:06,327 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-01-29 03:17:06,333 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14502155438504559235', 'uuid-lslong': '11527738582296523076'}, 'enable': 'true', 'created': '2026-01-29T03:17:05', 'last-modified': '2026-01-29T03:17:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.487059'} 2026-01-29 03:17:06,340 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-01-29 03:17:06,340 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-19239895 passed 2026-01-29 03:17:06,341 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-19239895 in API_Server ====== 2026-01-29 03:17:06,341 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:17:06,347 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:17:06,358 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:17:06,466 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c9420189-1d90-4283-9ffa-c129fd597144 2026-01-29 03:17:06,478 - DEBUG - =>VN ctest-mgmt_vn-19239895 has no policy to be verified 2026-01-29 03:17:06,479 - DEBUG - Verifying the vn in opserver 2026-01-29 03:17:06,479 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895 virtual network link through opserver 10.0.0.23 2026-01-29 03:17:06,479 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-01-29 03:17:06,552 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895?flat'} 2026-01-29 03:17:06,552 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895 virtual network link through opserver 10.0.0.147 2026-01-29 03:17:06,552 - DEBUG - Requesting: http://10.0.0.147:8081/analytics/uves/virtual-networks 2026-01-29 03:17:06,629 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895', 'href': 'http://10.0.0.147:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895?flat'} 2026-01-29 03:17:06,629 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895 virtual network link through opserver 10.0.0.240 2026-01-29 03:17:06,629 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-29 03:17:06,702 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895?flat'} 2026-01-29 03:17:06,702 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-06727449:ctest-mgmt_vn-19239895 is found in opserver 2026-01-29 03:17:06,727 - DEBUG - Do not have enough data to verify VN in agent 2026-01-29 03:17:06,738 - DEBUG - VRF ids for VN ctest-mgmt_vn-19239895: {} 2026-01-29 03:17:07,042 - DEBUG - Response for create_network : {'network': {'id': '97d40243-dc7d-43d6-baab-ae0df068195b', 'name': 'ctest-trans_left_vn-30365500', 'tenant_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'project_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-06727449', 'ctest-trans_left_vn-30365500'], 'port_security_enabled': True, 'description': ''}} 2026-01-29 03:17:07,352 - DEBUG - Response for create_subnet : {'subnet': {'id': '6489d84e-8800-4bcb-89d8-10627824eb27', 'name': '', 'tenant_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'network_id': '97d40243-dc7d-43d6-baab-ae0df068195b', 'ip_version': 4, 'cidr': '115.191.99.64/26', 'allocation_pools': [{'start': '115.191.99.66', 'end': '115.191.99.126'}], 'gateway_ip': '115.191.99.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '115.191.99.66', 'tags': [], 'project_id': 'abf890ecc85243e382c6a5a5b27d8b53'}} 2026-01-29 03:17:07,378 - INFO - Created VN ctest-trans_left_vn-30365500 2026-01-29 03:17:07,390 - DEBUG - VN ctest-trans_left_vn-30365500 UUID is 97d40243-dc7d-43d6-baab-ae0df068195b 2026-01-29 03:17:07,471 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:17:07,478 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:17:07,495 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:17:07,582 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/97d40243-dc7d-43d6-baab-ae0df068195b 2026-01-29 03:17:07,595 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/97d40243-dc7d-43d6-baab-ae0df068195b 2026-01-29 03:17:07,606 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2a523387-6a09-43b3-8017-d97dab7a80fb 2026-01-29 03:17:07,621 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2a523387-6a09-43b3-8017-d97dab7a80fb 2026-01-29 03:17:07,629 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/95984061-3ae8-407e-853b-0ce6a6750181 2026-01-29 03:17:07,639 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-01-29 03:17:07,639 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/97d40243-dc7d-43d6-baab-ae0df068195b 2026-01-29 03:17:07,649 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2a523387-6a09-43b3-8017-d97dab7a80fb 2026-01-29 03:17:07,668 - INFO - Verified VN network id 16 for VN 97d40243-dc7d-43d6-baab-ae0df068195b 2026-01-29 03:17:07,668 - INFO - Verifications in API Server for VN ctest-trans_left_vn-30365500 passed 2026-01-29 03:17:07,668 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/97d40243-dc7d-43d6-baab-ae0df068195b 2026-01-29 03:17:07,677 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2a523387-6a09-43b3-8017-d97dab7a80fb 2026-01-29 03:17:07,686 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2a523387-6a09-43b3-8017-d97dab7a80fb 2026-01-29 03:17:07,694 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/95984061-3ae8-407e-853b-0ce6a6750181 2026-01-29 03:17:07,706 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10940371885275038678', 'uuid-lslong': '13451036086963280219'}, 'enable': 'true', 'created': '2026-01-29T03:17:06', 'last-modified': '2026-01-29T03:17:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.380440'} 2026-01-29 03:17:07,713 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-01-29 03:17:07,718 - DEBUG - Control-node 10.0.0.147 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10940371885275038678', 'uuid-lslong': '13451036086963280219'}, 'enable': 'true', 'created': '2026-01-29T03:17:06', 'last-modified': '2026-01-29T03:17:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.412756'} 2026-01-29 03:17:07,725 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-01-29 03:17:07,732 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10940371885275038678', 'uuid-lslong': '13451036086963280219'}, 'enable': 'true', 'created': '2026-01-29T03:17:06', 'last-modified': '2026-01-29T03:17:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424810'} 2026-01-29 03:17:07,741 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-01-29 03:17:07,741 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-30365500 passed 2026-01-29 03:17:07,741 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-30365500 in API_Server ====== 2026-01-29 03:17:07,742 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:17:07,750 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:17:07,764 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:17:07,855 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/97d40243-dc7d-43d6-baab-ae0df068195b 2026-01-29 03:17:07,875 - DEBUG - =>VN ctest-trans_left_vn-30365500 has no policy to be verified 2026-01-29 03:17:07,875 - DEBUG - Verifying the vn in opserver 2026-01-29 03:17:07,875 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 virtual network link through opserver 10.0.0.23 2026-01-29 03:17:07,875 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-01-29 03:17:07,889 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500?flat'} 2026-01-29 03:17:07,889 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 virtual network link through opserver 10.0.0.147 2026-01-29 03:17:07,889 - DEBUG - Requesting: http://10.0.0.147:8081/analytics/uves/virtual-networks 2026-01-29 03:17:07,902 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500', 'href': 'http://10.0.0.147:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500?flat'} 2026-01-29 03:17:07,902 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 virtual network link through opserver 10.0.0.240 2026-01-29 03:17:07,902 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-29 03:17:07,916 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500?flat'} 2026-01-29 03:17:07,916 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is found in opserver 2026-01-29 03:17:07,940 - DEBUG - Do not have enough data to verify VN in agent 2026-01-29 03:17:07,952 - DEBUG - VRF ids for VN ctest-trans_left_vn-30365500: {} 2026-01-29 03:17:08,262 - DEBUG - Response for create_network : {'network': {'id': '8bc33bfb-ce4e-4060-9b2a-edee1e9d299a', 'name': 'ctest-trans_right_vn-70901306', 'tenant_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'project_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-06727449', 'ctest-trans_right_vn-70901306'], 'port_security_enabled': True, 'description': ''}} 2026-01-29 03:17:08,479 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cf3f6468-afd9-4f59-8334-fbfe2ca6a9ba', 'name': '', 'tenant_id': 'abf890ecc85243e382c6a5a5b27d8b53', 'network_id': '8bc33bfb-ce4e-4060-9b2a-edee1e9d299a', 'ip_version': 4, 'cidr': '139.255.8.192/26', 'allocation_pools': [{'start': '139.255.8.194', 'end': '139.255.8.254'}], 'gateway_ip': '139.255.8.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '139.255.8.194', 'tags': [], 'project_id': 'abf890ecc85243e382c6a5a5b27d8b53'}} 2026-01-29 03:17:08,503 - INFO - Created VN ctest-trans_right_vn-70901306 2026-01-29 03:17:08,518 - DEBUG - VN ctest-trans_right_vn-70901306 UUID is 8bc33bfb-ce4e-4060-9b2a-edee1e9d299a 2026-01-29 03:17:08,593 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:17:08,600 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:17:08,612 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:17:08,723 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8bc33bfb-ce4e-4060-9b2a-edee1e9d299a 2026-01-29 03:17:08,737 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8bc33bfb-ce4e-4060-9b2a-edee1e9d299a 2026-01-29 03:17:08,747 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/16ca73dd-d6d8-4b1f-8f9d-5520eb7a9b01 2026-01-29 03:17:08,767 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/16ca73dd-d6d8-4b1f-8f9d-5520eb7a9b01 2026-01-29 03:17:08,776 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/93f4840a-429f-4871-9307-358d1f021c90 2026-01-29 03:17:08,783 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-01-29 03:17:08,783 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8bc33bfb-ce4e-4060-9b2a-edee1e9d299a 2026-01-29 03:17:08,795 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/16ca73dd-d6d8-4b1f-8f9d-5520eb7a9b01 2026-01-29 03:17:08,820 - INFO - Verified VN network id 17 for VN 8bc33bfb-ce4e-4060-9b2a-edee1e9d299a 2026-01-29 03:17:08,820 - INFO - Verifications in API Server for VN ctest-trans_right_vn-70901306 passed 2026-01-29 03:17:08,820 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8bc33bfb-ce4e-4060-9b2a-edee1e9d299a 2026-01-29 03:17:08,830 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/16ca73dd-d6d8-4b1f-8f9d-5520eb7a9b01 2026-01-29 03:17:08,838 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/16ca73dd-d6d8-4b1f-8f9d-5520eb7a9b01 2026-01-29 03:17:08,846 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/93f4840a-429f-4871-9307-358d1f021c90 2026-01-29 03:17:08,860 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10070959144414625888', 'uuid-lslong': '11181010631872293274'}, 'enable': 'true', 'created': '2026-01-29T03:17:08', 'last-modified': '2026-01-29T03:17:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.432268'} 2026-01-29 03:17:08,868 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-01-29 03:17:08,875 - DEBUG - Control-node 10.0.0.147 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10070959144414625888', 'uuid-lslong': '11181010631872293274'}, 'enable': 'true', 'created': '2026-01-29T03:17:08', 'last-modified': '2026-01-29T03:17:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.450083'} 2026-01-29 03:17:08,881 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-01-29 03:17:08,889 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06727449', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10070959144414625888', 'uuid-lslong': '11181010631872293274'}, 'enable': 'true', 'created': '2026-01-29T03:17:08', 'last-modified': '2026-01-29T03:17:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.461772'} 2026-01-29 03:17:08,909 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-01-29 03:17:08,909 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-70901306 passed 2026-01-29 03:17:08,909 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-70901306 in API_Server ====== 2026-01-29 03:17:08,909 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:17:08,922 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:17:08,933 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:17:09,027 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8bc33bfb-ce4e-4060-9b2a-edee1e9d299a 2026-01-29 03:17:09,040 - DEBUG - =>VN ctest-trans_right_vn-70901306 has no policy to be verified 2026-01-29 03:17:09,040 - DEBUG - Verifying the vn in opserver 2026-01-29 03:17:09,040 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306 virtual network link through opserver 10.0.0.23 2026-01-29 03:17:09,040 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-01-29 03:17:09,052 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306?flat'} 2026-01-29 03:17:09,052 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306 virtual network link through opserver 10.0.0.147 2026-01-29 03:17:09,052 - DEBUG - Requesting: http://10.0.0.147:8081/analytics/uves/virtual-networks 2026-01-29 03:17:09,063 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306', 'href': 'http://10.0.0.147:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306?flat'} 2026-01-29 03:17:09,063 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306 virtual network link through opserver 10.0.0.240 2026-01-29 03:17:09,063 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-29 03:17:09,075 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306?flat'} 2026-01-29 03:17:09,075 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_right_vn-70901306 is found in opserver 2026-01-29 03:17:09,098 - DEBUG - Do not have enough data to verify VN in agent 2026-01-29 03:17:09,109 - DEBUG - VRF ids for VN ctest-trans_right_vn-70901306: {} 2026-01-29 03:17:09,177 - DEBUG - Services list from nova: [, , , ] 2026-01-29 03:17:10,345 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5115-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5115-1) 2026-01-29 03:17:11,774 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5115-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5115-2) 2026-01-29 03:17:11,774 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-83616211'] 2026-01-29 03:17:12,073 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-83616211'] created succesfully 2026-01-29 03:17:13,515 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5115-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5115-1) 2026-01-29 03:17:13,515 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/b07bc9cc-6b03-4a70-b445-ed3ff158ad62 2026-01-29 03:17:13,829 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/b07bc9cc-6b03-4a70-b445-ed3ff158ad62 2026-01-29 03:17:13,876 - DEBUG - Response Code: 404 2026-01-29 03:17:15,877 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/b07bc9cc-6b03-4a70-b445-ed3ff158ad62 2026-01-29 03:17:15,890 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/92ddc28d-148b-48b7-9a9e-06b73b3f7bc3 2026-01-29 03:17:15,978 - INFO - Waiting for VM ctest-pt_svm0-00516175 to be up.. 2026-01-29 03:17:16,077 - DEBUG - VM is in ACTIVE state now 2026-01-29 03:17:16,077 - INFO - VM name : ctest-pt_svm0-00516175 2026-01-29 03:17:16,165 - DEBUG - VM ctest-pt_svm0-00516175 ID is b07bc9cc-6b03-4a70-b445-ed3ff158ad62 2026-01-29 03:17:16,190 - DEBUG - VM ctest-pt_svm0-00516175 launched on Node an-jenkins-deploy-platform-ansible-os-5115-1 2026-01-29 03:17:16,273 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/b07bc9cc-6b03-4a70-b445-ed3ff158ad62 2026-01-29 03:17:16,283 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/92ddc28d-148b-48b7-9a9e-06b73b3f7bc3 2026-01-29 03:17:19,467 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-01-29 03:17:19,467 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:17:19,484 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:17:23,564 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2026-01-29 03:17:23,564 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:17:23,578 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:17:27,664 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2026-01-29 03:17:27,664 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:17:27,680 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:17:31,755 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2026-01-29 03:17:31,755 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:17:31,772 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:17:35,851 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2026-01-29 03:17:35,851 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:17:35,865 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:17:39,950 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2026-01-29 03:17:39,950 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:17:39,966 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:17:44,044 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2026-01-29 03:17:44,044 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:17:44,060 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:17:48,142 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2026-01-29 03:17:48,142 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:17:48,157 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:17:52,233 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2026-01-29 03:17:52,233 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:17:52,250 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:17:56,342 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2026-01-29 03:17:56,342 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:17:56,361 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:18:00,434 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2026-01-29 03:18:00,434 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:18:00,448 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:18:04,528 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2026-01-29 03:18:04,528 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:18:04,543 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:18:08,624 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2026-01-29 03:18:08,624 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 failed! 2026-01-29 03:18:08,638 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is 115.191.99.65 and allocation pool is NOT set 2026-01-29 03:18:10,707 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=18.9 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=1.18 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.184/10.036/18.888/8.852 ms') 2026-01-29 03:18:10,707 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 passed 2026-01-29 03:18:10,774 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-29 03:18:10,774 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-00516175, IP 115.191.99.67, Port 22 2026-01-29 03:18:10,847 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-29 03:18:10,956 - DEBUG - VM ctest-pt_svm0-00516175 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-29 03:18:15,957 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-29 03:18:15,957 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-00516175, IP 115.191.99.67, Port 22 2026-01-29 03:18:16,032 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-29 03:18:16,124 - DEBUG - VM ctest-pt_svm0-00516175 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-29 03:18:21,125 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-29 03:18:21,125 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-00516175, IP 115.191.99.67, Port 22 2026-01-29 03:18:21,191 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-29 03:18:21,272 - DEBUG - VM ctest-pt_svm0-00516175 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-29 03:18:26,273 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-29 03:18:26,273 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-00516175, IP 115.191.99.67, Port 22 2026-01-29 03:18:26,339 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-29 03:18:26,420 - DEBUG - VM ctest-pt_svm0-00516175 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-29 03:18:31,421 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-29 03:18:31,422 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-00516175, IP 115.191.99.67, Port 22 2026-01-29 03:18:31,491 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-29 03:18:31,576 - DEBUG - VM ctest-pt_svm0-00516175 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-29 03:18:36,577 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-29 03:18:36,577 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-00516175, IP 115.191.99.67, Port 22 2026-01-29 03:18:36,749 - DEBUG - VM ctest-pt_svm0-00516175 is ready for SSH connections 2026-01-29 03:18:36,755 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSVCV2Mirror-06727449', 'ctest-si-61415725'] 2026-01-29 03:18:37,254 - INFO - Waiting for VM ctest-left_vm-16081348 to be up.. 2026-01-29 03:18:37,349 - DEBUG - VM is in ACTIVE state now 2026-01-29 03:18:37,349 - INFO - VM name : ctest-left_vm-16081348 2026-01-29 03:18:37,464 - DEBUG - VM ctest-left_vm-16081348 ID is 33e5e96a-7f0e-4c3c-b4dd-11690f1063ea 2026-01-29 03:18:37,464 - DEBUG - VM ctest-left_vm-16081348 launched on Node an-jenkins-deploy-platform-ansible-os-5115-1 2026-01-29 03:18:37,592 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/33e5e96a-7f0e-4c3c-b4dd-11690f1063ea 2026-01-29 03:18:37,602 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/1846c1df-9009-41b2-934e-a2d5bf534c57 2026-01-29 03:18:38,773 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.07 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.24 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.238/3.653/6.068/2.415 ms') 2026-01-29 03:18:38,773 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-16081348 passed 2026-01-29 03:18:38,846 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-29 03:18:38,846 - DEBUG - Waiting to SSH to VM ctest-left_vm-16081348, IP 157.230.16.195, Port 22 2026-01-29 03:18:39,015 - DEBUG - VM ctest-left_vm-16081348 is ready for SSH connections 2026-01-29 03:18:39,015 - INFO - Waiting for VM ctest-right_vm-76805713 to be up.. 2026-01-29 03:18:39,106 - DEBUG - VM is in ACTIVE state now 2026-01-29 03:18:39,106 - INFO - VM name : ctest-right_vm-76805713 2026-01-29 03:18:39,179 - DEBUG - VM ctest-right_vm-76805713 ID is 1bc23a98-e8db-4701-98a9-73d578a4fef0 2026-01-29 03:18:39,179 - DEBUG - VM ctest-right_vm-76805713 launched on Node an-jenkins-deploy-platform-ansible-os-5115-2 2026-01-29 03:18:39,254 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/1bc23a98-e8db-4701-98a9-73d578a4fef0 2026-01-29 03:18:39,265 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/f9f43e5e-91fd-41c1-b68a-e81778e85768 2026-01-29 03:18:40,429 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.43 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.80 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.801/3.114/3.428/0.313 ms') 2026-01-29 03:18:40,430 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-right_vm-76805713 passed 2026-01-29 03:18:40,499 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-29 03:18:40,499 - DEBUG - Waiting to SSH to VM ctest-right_vm-76805713, IP 52.42.78.195, Port 22 2026-01-29 03:18:40,675 - DEBUG - VM ctest-right_vm-76805713 is ready for SSH connections 2026-01-29 03:18:40,682 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-06727449:ctest-si-61415725, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-01-29 03:18:41,030 - INFO - Attaching policy ctest-policy-84604375 to vn ctest-left-80745407 2026-01-29 03:18:41,427 - INFO - Attaching policy ctest-policy-84604375 to vn ctest-right-79274129 2026-01-29 03:18:41,776 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-83616211'] created succesfully 2026-01-29 03:18:41,972 - DEBUG - Service instance: ['default-domain', 'ctest-TestSVCV2Mirror-06727449', 'ctest-si-61415725'] created succesfully 2026-01-29 03:18:41,972 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:18:41,979 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:18:41,992 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:18:42,083 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/2f3161a7-f6c3-45a3-8295-adb33b27266c 2026-01-29 03:18:42,093 - DEBUG - SI 'ctest-si-61415725' has service template ref to ctest-service_template_1-83616211 2026-01-29 03:18:42,093 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:18:42,098 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:18:42,111 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:18:42,208 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/2f3161a7-f6c3-45a3-8295-adb33b27266c 2026-01-29 03:18:42,216 - DEBUG - Requesting: http://10.0.0.23:8082/port-tuple/182bd238-ac78-46e7-8a37-425c80dac7a4 2026-01-29 03:18:42,223 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/92ddc28d-148b-48b7-9a9e-06b73b3f7bc3 2026-01-29 03:18:42,413 - DEBUG - VM is in ACTIVE state now 2026-01-29 03:18:42,638 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/b07bc9cc-6b03-4a70-b445-ed3ff158ad62 2026-01-29 03:18:42,647 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/92ddc28d-148b-48b7-9a9e-06b73b3f7bc3 2026-01-29 03:18:42,659 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/6982fb82-0eeb-404d-8fb2-48cef30f7264 2026-01-29 03:18:42,670 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/e2e1d245-dcc7-48a2-b571-17db81754201 2026-01-29 03:18:42,678 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/f08d5598-b5c0-419f-93be-68dbef507a84 2026-01-29 03:18:42,888 - DEBUG - VM is in ACTIVE state now 2026-01-29 03:18:42,888 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/b07bc9cc-6b03-4a70-b445-ed3ff158ad62 2026-01-29 03:18:42,897 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/92ddc28d-148b-48b7-9a9e-06b73b3f7bc3 2026-01-29 03:18:44,066 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=1.90 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=0.477 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.477/1.186/1.895/0.709 ms') 2026-01-29 03:18:44,066 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-00516175 passed 2026-01-29 03:18:44,110 - DEBUG - VM ctest-pt_svm0-00516175 Tap interface: {'index': '4', 'name': 'tap92ddc28d-14', 'uuid': '92ddc28d-148b-48b7-9a9e-06b73b3f7bc3', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500:ctest-trans_left_vn-30365500', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '34', 'vxlan_id': '16', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500', 'vm_uuid': 'b07bc9cc-6b03-4a70-b445-ed3ff158ad62', 'vm_name': 'ctest-pt_svm0-00516175', 'ip_addr': '115.191.99.67', 'mac_addr': '02:92:dd:c2:8d:14', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-06727449:92ddc28d-148b-48b7-9a9e-06b73b3f7bc3', 'sg_uuid_list': ['4ae4ff46-73fb-44e7-a91b-f46bc15c84e8'], 'static_route_list': None, 'vm_project_uuid': 'abf890ec-c852-43e3-82c6-a5a5b27d8b53', 'admin_state': 'Enabled', 'flow_key_idx': '35', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-29 03:18:44,110 - DEBUG - Agent 10.0.0.49 vrf name: default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500:ctest-trans_left_vn-30365500 2026-01-29 03:18:44,122 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500:ctest-trans_left_vn-30365500', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500', 'table_label': '-1', 'vxlan_id': '16', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.129:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-01-29 03:18:44,211 - DEBUG - VM ctest-pt_svm0-00516175 : Tap interface tap92ddc28d-14 is set to Active 2026-01-29 03:18:44,212 - DEBUG - Tap interface tap92ddc28d-14 detail : {'index': '4', 'name': 'tap92ddc28d-14', 'uuid': '92ddc28d-148b-48b7-9a9e-06b73b3f7bc3', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500:ctest-trans_left_vn-30365500', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '34', 'vxlan_id': '16', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500', 'vm_uuid': 'b07bc9cc-6b03-4a70-b445-ed3ff158ad62', 'vm_name': 'ctest-pt_svm0-00516175', 'ip_addr': '115.191.99.67', 'mac_addr': '02:92:dd:c2:8d:14', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-06727449:92ddc28d-148b-48b7-9a9e-06b73b3f7bc3', 'sg_uuid_list': ['4ae4ff46-73fb-44e7-a91b-f46bc15c84e8'], 'static_route_list': None, 'vm_project_uuid': 'abf890ec-c852-43e3-82c6-a5a5b27d8b53', 'admin_state': 'Enabled', 'flow_key_idx': '35', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-29 03:18:44,327 - DEBUG - Starting Layer 2 verification in Agent 2026-01-29 03:18:44,338 - DEBUG - Layer 2 path is seen for VM MAC 02:92:dd:c2:8d:14 in agent 10.0.0.49 2026-01-29 03:18:44,339 - DEBUG - Active layer 2 route in agent is present for VMI tap92ddc28d-14 2026-01-29 03:18:44,339 - DEBUG - L2 label(34) matches bw route table and interface table 2026-01-29 03:18:44,345 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is found in Agent of node 10.0.0.49 2026-01-29 03:18:44,481 - DEBUG - VRF IDs of VN default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 is consistent in agent 10.0.0.49 2026-01-29 03:18:44,482 - DEBUG - Route for VM IP ['115.191.99.67'] is consistent in agent 10.0.0.49 2026-01-29 03:18:44,482 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-06727449:ctest-trans_left_vn-30365500 verification for VM ctest-pt_svm0-00516175 in Agent 10.0.0.49 passed 2026-01-29 03:18:44,595 - DEBUG - Starting all layer 2 verification in agent 10.0.0.49 2026-01-29 03:18:44,608 - DEBUG - Route for VM MAC 02:92:dd:c2:8d:14 is consistent in agent 10.0.0.49 2026-01-29 03:18:44,615 - INFO - VM ctest-pt_svm0-00516175 verifications in Compute nodes passed 2026-01-29 03:18:44,615 - DEBUG - The SVMs in the SI are : [] 2026-01-29 03:18:44,615 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b07bc9cc-6b03-4a70-b445-ed3ff158ad62 2026-01-29 03:18:44,625 - DEBUG - Service VM for SI 'ctest-si-61415725' is launched 2026-01-29 03:18:44,625 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:18:44,630 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:18:44,643 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:18:44,734 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/2f3161a7-f6c3-45a3-8295-adb33b27266c 2026-01-29 03:18:44,744 - DEBUG - SI ctest-si-61415725 has Port Tuple: ['ctest-port_tuple-37504505'] 2026-01-29 03:18:44,806 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407 2026-01-29 03:18:44,871 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129 2026-01-29 03:18:44,871 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-29 03:18:44,871 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-29 03:18:44,871 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 52.42.78.195, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2026-01-29 03:18:44,871 - DEBUG - ping -s 56 -c 3 -W 1 52.42.78.195 2026-01-29 03:19:47,018 - DEBUG - PING 52.42.78.195 (52.42.78.195) 56(84) bytes of data. 64 bytes from 52.42.78.195: icmp_req=1 ttl=63 time=9.50 ms 64 bytes from 52.42.78.195: icmp_req=2 ttl=63 time=1.31 ms 64 bytes from 52.42.78.195: icmp_req=3 ttl=63 time=1.70 ms --- 52.42.78.195 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.312/4.175/9.506/3.773 ms 2026-01-29 03:19:47,018 - INFO - Ping to IP 52.42.78.195 from VM ctest-left_vm-16081348 passed 2026-01-29 03:19:47,027 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-06727449:ctest-si-61415725, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-06727449:ctest-left-80745407, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-06727449:ctest-right-79274129, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-06727449:ctest-si-61415725, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-01-29 03:19:47,094 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-29 03:19:47,094 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:19:47,099 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:19:47,109 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:19:47,197 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/2f3161a7-f6c3-45a3-8295-adb33b27266c 2026-01-29 03:19:47,205 - DEBUG - Requesting: http://10.0.0.23:8082/port-tuple/182bd238-ac78-46e7-8a37-425c80dac7a4 2026-01-29 03:19:47,211 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/92ddc28d-148b-48b7-9a9e-06b73b3f7bc3 2026-01-29 03:19:47,389 - DEBUG - Executing command: rm -f /tmp/mirror-tap92ddc28d-14_ctest-random-64037216.pcap 2026-01-29 03:19:57,863 - INFO - Starting tcpdump to capture the mirrored packets. 2026-01-29 03:19:57,864 - DEBUG - Executing command: sudo tcpdump -ni tap92ddc28d-14 -U udp port 8099 -w /tmp/mirror-tap92ddc28d-14_ctest-random-64037216.pcap 2026-01-29 03:20:07,896 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 52.42.78.195, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2026-01-29 03:20:07,896 - DEBUG - ping -s 56 -c 3 -W 1 52.42.78.195 2026-01-29 03:20:10,451 - DEBUG - PING 52.42.78.195 (52.42.78.195) 56(84) bytes of data. 64 bytes from 52.42.78.195: icmp_req=1 ttl=63 time=4.35 ms 64 bytes from 52.42.78.195: icmp_req=2 ttl=63 time=1.61 ms 64 bytes from 52.42.78.195: icmp_req=3 ttl=63 time=1.50 ms --- 52.42.78.195 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.502/2.488/4.352/1.318 ms 2026-01-29 03:20:10,452 - INFO - Ping to IP 52.42.78.195 from VM ctest-left_vm-16081348 passed 2026-01-29 03:20:10,452 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:20:10,461 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:20:10,501 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:20:10,593 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/2f3161a7-f6c3-45a3-8295-adb33b27266c 2026-01-29 03:20:10,601 - DEBUG - Requesting: http://10.0.0.23:8082/port-tuple/182bd238-ac78-46e7-8a37-425c80dac7a4 2026-01-29 03:20:10,608 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/92ddc28d-148b-48b7-9a9e-06b73b3f7bc3 2026-01-29 03:20:10,710 - DEBUG - Waiting for the tcpdump write to complete. 2026-01-29 03:20:12,712 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tap92ddc28d-14_ctest-random-64037216.pcap| awk '{print $2}') 2026-01-29 03:20:12,715 - DEBUG - Executing command: sync 2026-01-29 03:20:15,740 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap92ddc28d-14_ctest-random-64037216.pcap | wc -l 2026-01-29 03:20:15,757 - DEBUG - STDOUT: 12 2026-01-29 03:20:15,757 - DEBUG - STDERR: reading from file /tmp/mirror-tap92ddc28d-14_ctest-random-64037216.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2026-01-29 03:20:15,757 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap92ddc28d-14_ctest-random-64037216.pcap 2026-01-29 03:20:15,803 - INFO - 12 ICMP packets are mirrored to the analyzer service VM 'ctest-pt_svm0-00516175' 2026-01-29 03:20:15,804 - INFO - Dettaching policy ctest-policy-84604375 from vn ctest-right-79274129 2026-01-29 03:20:16,011 - INFO - Dettaching policy ctest-policy-84604375 from vn ctest-left-80745407 2026-01-29 03:20:16,346 - INFO - Deleted policy ctest-policy-84604375 2026-01-29 03:20:16,346 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSVCV2Mirror-06727449', 'ctest-si-61415725'] 2026-01-29 03:20:16,472 - INFO - Deleted SI ['default-domain', 'ctest-TestSVCV2Mirror-06727449', 'ctest-si-61415725'] 2026-01-29 03:20:16,472 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:20:16,481 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:20:16,505 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:20:16,633 - DEBUG - Service instance ctest-si-61415725 removed from api server 2026-01-29 03:20:16,633 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b07bc9cc-6b03-4a70-b445-ed3ff158ad62 2026-01-29 03:20:16,642 - DEBUG - All Service VMs unlinked from SI ctest-si-61415725 2026-01-29 03:20:16,649 - DEBUG - 0 svc intances found in all projects. They are [] 2026-01-29 03:20:16,649 - DEBUG - 0 svc intances found in current project. They are [] 2026-01-29 03:20:16,697 - DEBUG - 0 svc intances found in all projects. They are [] 2026-01-29 03:20:16,698 - DEBUG - 0 svc intances found in current project. They are [] 2026-01-29 03:20:16,698 - INFO - Deleting VM ctest-pt_svm0-00516175 2026-01-29 03:20:16,790 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-83616211'] 2026-01-29 03:20:16,882 - INFO - Service template: ['default-domain', 'ctest-service_template_1-83616211'] deleted successfully. 2026-01-29 03:20:16,882 - INFO - Deleting VM ctest-right_vm-76805713 2026-01-29 03:20:16,958 - INFO - Deleting VM ctest-left_vm-16081348 2026-01-29 03:20:17,023 - INFO - Deleting VN ctest-trans_right_vn-70901306 2026-01-29 03:20:17,224 - DEBUG - Response for deleting network () 2026-01-29 03:20:17,224 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/16ca73dd-d6d8-4b1f-8f9d-5520eb7a9b01 2026-01-29 03:20:17,230 - DEBUG - Response Code: 404 2026-01-29 03:20:17,230 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:20:17,236 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:20:17,250 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:20:17,336 - INFO - Validated that VN ctest-trans_right_vn-70901306 is not found in API Server 2026-01-29 03:20:17,350 - DEBUG - VN ctest-trans_right_vn-70901306 is not present in Agent 10.0.0.49 2026-01-29 03:20:17,363 - DEBUG - VN ctest-trans_right_vn-70901306 is not present in Agent 10.0.0.128 2026-01-29 03:20:17,363 - INFO - Validated that VN ctest-trans_right_vn-70901306 is not in any agent 2026-01-29 03:20:17,401 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-70901306 info 2026-01-29 03:20:17,401 - INFO - Deleting VN ctest-trans_left_vn-30365500 2026-01-29 03:20:17,442 - DEBUG - VN 97d40243-dc7d-43d6-baab-ae0df068195b still in use: Unable to complete operation on network 97d40243-dc7d-43d6-baab-ae0df068195b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-3be3f9e2-0951-49cd-8fda-1228ba5d0368'] 2026-01-29 03:20:17,443 - WARNING - Deleting VN ctest-trans_left_vn-30365500 failed..Will retry 2026-01-29 03:20:19,637 - DEBUG - Response for deleting network () 2026-01-29 03:20:19,637 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2a523387-6a09-43b3-8017-d97dab7a80fb 2026-01-29 03:20:19,643 - DEBUG - Response Code: 404 2026-01-29 03:20:19,643 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:20:19,649 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:20:19,658 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:20:19,748 - INFO - Validated that VN ctest-trans_left_vn-30365500 is not found in API Server 2026-01-29 03:20:19,758 - DEBUG - VN ctest-trans_left_vn-30365500 is not present in Agent 10.0.0.49 2026-01-29 03:20:19,769 - DEBUG - VN ctest-trans_left_vn-30365500 is not present in Agent 10.0.0.128 2026-01-29 03:20:19,769 - INFO - Validated that VN ctest-trans_left_vn-30365500 is not in any agent 2026-01-29 03:20:19,797 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-30365500 info 2026-01-29 03:20:19,797 - INFO - Deleting VN ctest-mgmt_vn-19239895 2026-01-29 03:20:19,956 - DEBUG - Response for deleting network () 2026-01-29 03:20:19,956 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ea746d58-c5df-4927-a6e9-a162d850610e 2026-01-29 03:20:19,963 - DEBUG - Response Code: 404 2026-01-29 03:20:19,963 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:20:19,972 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:20:19,998 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:20:20,086 - INFO - Validated that VN ctest-mgmt_vn-19239895 is not found in API Server 2026-01-29 03:20:20,101 - DEBUG - VN ctest-mgmt_vn-19239895 is not present in Agent 10.0.0.49 2026-01-29 03:20:20,115 - DEBUG - VN ctest-mgmt_vn-19239895 is not present in Agent 10.0.0.128 2026-01-29 03:20:20,115 - INFO - Validated that VN ctest-mgmt_vn-19239895 is not in any agent 2026-01-29 03:20:20,151 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-19239895 info 2026-01-29 03:20:20,151 - INFO - Deleting VN ctest-right-79274129 2026-01-29 03:20:20,309 - DEBUG - Response for deleting network () 2026-01-29 03:20:20,310 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d6724554-0d0b-4856-ad87-13a0415eab31 2026-01-29 03:20:20,335 - DEBUG - Response Code: 404 2026-01-29 03:20:20,335 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:20:20,342 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:20:20,356 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:20:20,436 - INFO - Validated that VN ctest-right-79274129 is not found in API Server 2026-01-29 03:20:20,451 - DEBUG - VN ctest-right-79274129 is not present in Agent 10.0.0.49 2026-01-29 03:20:20,466 - DEBUG - VN ctest-right-79274129 is not present in Agent 10.0.0.128 2026-01-29 03:20:20,466 - INFO - Validated that VN ctest-right-79274129 is not in any agent 2026-01-29 03:20:20,500 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-79274129 info 2026-01-29 03:20:20,501 - INFO - Deleting VN ctest-left-80745407 2026-01-29 03:20:20,674 - DEBUG - Response for deleting network () 2026-01-29 03:20:20,675 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/65b610bc-dcea-4643-b4bc-bc58c0ad0913 2026-01-29 03:20:20,684 - DEBUG - Response Code: 404 2026-01-29 03:20:20,685 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-29 03:20:20,692 - DEBUG - Requesting: http://10.0.0.23:8082/domain/65230a56-1cf0-4d34-9498-1ad48da04806 2026-01-29 03:20:20,703 - DEBUG - Requesting: http://10.0.0.23:8082/project/abf890ec-c852-43e3-82c6-a5a5b27d8b53 2026-01-29 03:20:20,789 - INFO - Validated that VN ctest-left-80745407 is not found in API Server 2026-01-29 03:20:20,801 - DEBUG - VN ctest-left-80745407 is not present in Agent 10.0.0.49 2026-01-29 03:20:20,811 - DEBUG - VN ctest-left-80745407 is not present in Agent 10.0.0.128 2026-01-29 03:20:20,811 - INFO - Validated that VN ctest-left-80745407 is not in any agent 2026-01-29 03:20:20,840 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-80745407 info 2026-01-29 03:20:22,109 - DEBUG - No XMPP flaps were noticed during the test 2026-01-29 03:20:22,109 - INFO -
2026-01-29 03:20:22,109 - INFO - END TEST : test_svc_v2_mirroring : PASSED[0:03:23]
2026-01-29 03:20:22,109 - INFO - -------------------------------------------------------------------------------- 2026-01-29 03:20:22,826 - INFO - Deleted project: ctest-TestSVCV2Mirror-06727449, ID : abf890ec-c852-43e3-82c6-a5a5b27d8b53