2026-01-22 16:14:30,158 - INFO - Domain Default found not creating 2026-01-22 16:14:30,340 - INFO - Project ctest-TestSvcRegr-59331921 not found, creating it 2026-01-22 16:14:30,961 - INFO - Created Project:ctest-TestSvcRegr-59331921, ID : 2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:14:32,501 - INFO - ================================================================================ 2026-01-22 16:14:32,502 - INFO - STARTING TEST : test_svc_in_network_datapath 2026-01-22 16:14:33,784 - WARNING - Test is running with cores: {'10.0.0.65': ['core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-5062-3.1769096738']} 2026-01-22 16:14:33,799 - DEBUG - Nothing to compare xmpp stats {'10.0.0.130': {'10.20.0.252': '0', '10.20.0.249': '0'}, '10.0.0.73': {'10.20.0.5': '0', '10.20.0.252': '0'}} with 2026-01-22 16:14:33,799 - INFO - Initial checks done. Running the testcase now 2026-01-22 16:14:33,800 - INFO - 2026-01-22 16:14:34,568 - DEBUG - Response for create_network : {'network': {'id': '8804a462-c744-4180-aece-ad02d8a2c2c3', 'name': 'ctest-mgmt_vn-22262995', 'tenant_id': '2ffddae4633f40d48c4161f986385001', 'project_id': '2ffddae4633f40d48c4161f986385001', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-59331921', 'ctest-mgmt_vn-22262995'], 'port_security_enabled': True, 'description': ''}} 2026-01-22 16:14:34,905 - DEBUG - Response for create_subnet : {'subnet': {'id': '16a7ccc0-28e4-421f-ab0d-7ed9fb9607ce', 'name': '', 'tenant_id': '2ffddae4633f40d48c4161f986385001', 'network_id': '8804a462-c744-4180-aece-ad02d8a2c2c3', 'ip_version': 4, 'cidr': '59.144.238.64/26', 'allocation_pools': [{'start': '59.144.238.66', 'end': '59.144.238.126'}], 'gateway_ip': '59.144.238.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '59.144.238.66', 'tags': [], 'project_id': '2ffddae4633f40d48c4161f986385001'}} 2026-01-22 16:14:34,934 - INFO - Created VN ctest-mgmt_vn-22262995 2026-01-22 16:14:34,946 - DEBUG - VN ctest-mgmt_vn-22262995 UUID is 8804a462-c744-4180-aece-ad02d8a2c2c3 2026-01-22 16:14:35,035 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:14:35,363 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:14:35,398 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:14:35,416 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:14:35,534 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8804a462-c744-4180-aece-ad02d8a2c2c3 2026-01-22 16:14:35,552 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8804a462-c744-4180-aece-ad02d8a2c2c3 2026-01-22 16:14:35,564 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/1a1f8a0e-e125-4acf-be29-c54c42211aec 2026-01-22 16:14:35,574 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/1a1f8a0e-e125-4acf-be29-c54c42211aec 2026-01-22 16:14:35,582 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/ab88aec6-f6d3-43bd-985a-28f3605a3afe 2026-01-22 16:14:35,589 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-01-22 16:14:35,589 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8804a462-c744-4180-aece-ad02d8a2c2c3 2026-01-22 16:14:35,601 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/1a1f8a0e-e125-4acf-be29-c54c42211aec 2026-01-22 16:14:35,622 - INFO - Verified VN network id 11 for VN 8804a462-c744-4180-aece-ad02d8a2c2c3 2026-01-22 16:14:35,622 - INFO - Verifications in API Server for VN ctest-mgmt_vn-22262995 passed 2026-01-22 16:14:35,622 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8804a462-c744-4180-aece-ad02d8a2c2c3 2026-01-22 16:14:35,635 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/1a1f8a0e-e125-4acf-be29-c54c42211aec 2026-01-22 16:14:35,645 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/1a1f8a0e-e125-4acf-be29-c54c42211aec 2026-01-22 16:14:35,653 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/ab88aec6-f6d3-43bd-985a-28f3605a3afe 2026-01-22 16:14:35,667 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-59331921', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9801139433221931392', 'uuid-lslong': '12596195435537941187'}, 'enable': 'true', 'created': '2026-01-22T16:14:34', 'last-modified': '2026-01-22T16:14:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.827386'} 2026-01-22 16:14:35,674 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-01-22 16:14:35,680 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-59331921', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9801139433221931392', 'uuid-lslong': '12596195435537941187'}, 'enable': 'true', 'created': '2026-01-22T16:14:34', 'last-modified': '2026-01-22T16:14:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.846585'} 2026-01-22 16:14:35,686 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-01-22 16:14:35,693 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-59331921', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9801139433221931392', 'uuid-lslong': '12596195435537941187'}, 'enable': 'true', 'created': '2026-01-22T16:14:34', 'last-modified': '2026-01-22T16:14:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.860198'} 2026-01-22 16:14:35,700 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-01-22 16:14:35,700 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-22262995 passed 2026-01-22 16:14:35,700 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-22262995 in API_Server ====== 2026-01-22 16:14:35,700 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:14:35,707 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:14:35,719 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:14:35,818 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8804a462-c744-4180-aece-ad02d8a2c2c3 2026-01-22 16:14:35,832 - DEBUG - =>VN ctest-mgmt_vn-22262995 has no policy to be verified 2026-01-22 16:14:35,832 - DEBUG - Verifying the vn in opserver 2026-01-22 16:14:35,832 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995 virtual network link through opserver 10.0.0.23 2026-01-22 16:14:35,832 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-01-22 16:14:36,135 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-01-22 16:14:36,227 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995?flat'} 2026-01-22 16:14:36,227 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995 virtual network link through opserver 10.0.0.240 2026-01-22 16:14:36,227 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-22 16:14:36,525 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-22 16:14:36,594 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995?flat'} 2026-01-22 16:14:36,594 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995 virtual network link through opserver 10.0.0.65 2026-01-22 16:14:36,595 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-01-22 16:14:36,889 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-01-22 16:14:36,954 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995?flat'} 2026-01-22 16:14:36,954 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995 is found in opserver 2026-01-22 16:14:36,975 - DEBUG - Do not have enough data to verify VN in agent 2026-01-22 16:14:36,985 - DEBUG - VRF ids for VN ctest-mgmt_vn-22262995: {} 2026-01-22 16:14:37,324 - DEBUG - Response for create_network : {'network': {'id': 'c137fdd4-3a6a-46b8-895a-81d114b7925e', 'name': 'ctest-left_vn-18099033', 'tenant_id': '2ffddae4633f40d48c4161f986385001', 'project_id': '2ffddae4633f40d48c4161f986385001', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-59331921', 'ctest-left_vn-18099033'], 'port_security_enabled': True, 'description': ''}} 2026-01-22 16:14:37,642 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e7195971-1dab-4dac-98fa-4367aa0e324b', 'name': '', 'tenant_id': '2ffddae4633f40d48c4161f986385001', 'network_id': 'c137fdd4-3a6a-46b8-895a-81d114b7925e', 'ip_version': 4, 'cidr': '196.49.46.128/26', 'allocation_pools': [{'start': '196.49.46.130', 'end': '196.49.46.190'}], 'gateway_ip': '196.49.46.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '196.49.46.130', 'tags': [], 'project_id': '2ffddae4633f40d48c4161f986385001'}} 2026-01-22 16:14:37,663 - INFO - Created VN ctest-left_vn-18099033 2026-01-22 16:14:37,675 - DEBUG - VN ctest-left_vn-18099033 UUID is c137fdd4-3a6a-46b8-895a-81d114b7925e 2026-01-22 16:14:37,751 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:14:37,757 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:14:37,771 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:14:37,880 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c137fdd4-3a6a-46b8-895a-81d114b7925e 2026-01-22 16:14:37,899 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c137fdd4-3a6a-46b8-895a-81d114b7925e 2026-01-22 16:14:37,912 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b103d803-ee9c-48db-9f6a-d342bf0d6ded 2026-01-22 16:14:37,922 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b103d803-ee9c-48db-9f6a-d342bf0d6ded 2026-01-22 16:14:37,929 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/326b3d1b-062b-43d7-be0c-aa2a8d023cff 2026-01-22 16:14:37,943 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-01-22 16:14:37,943 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c137fdd4-3a6a-46b8-895a-81d114b7925e 2026-01-22 16:14:37,957 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b103d803-ee9c-48db-9f6a-d342bf0d6ded 2026-01-22 16:14:37,977 - INFO - Verified VN network id 12 for VN c137fdd4-3a6a-46b8-895a-81d114b7925e 2026-01-22 16:14:37,977 - INFO - Verifications in API Server for VN ctest-left_vn-18099033 passed 2026-01-22 16:14:37,977 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c137fdd4-3a6a-46b8-895a-81d114b7925e 2026-01-22 16:14:37,997 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b103d803-ee9c-48db-9f6a-d342bf0d6ded 2026-01-22 16:14:38,008 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b103d803-ee9c-48db-9f6a-d342bf0d6ded 2026-01-22 16:14:38,018 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/326b3d1b-062b-43d7-be0c-aa2a8d023cff 2026-01-22 16:14:38,032 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-59331921', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13922875860994115256', 'uuid-lslong': '9897365866095809118'}, 'enable': 'true', 'created': '2026-01-22T16:14:37', 'last-modified': '2026-01-22T16:14:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.452557'} 2026-01-22 16:14:38,038 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-01-22 16:14:38,046 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-59331921', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13922875860994115256', 'uuid-lslong': '9897365866095809118'}, 'enable': 'true', 'created': '2026-01-22T16:14:37', 'last-modified': '2026-01-22T16:14:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.475624'} 2026-01-22 16:14:38,053 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-01-22 16:14:38,061 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-59331921', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13922875860994115256', 'uuid-lslong': '9897365866095809118'}, 'enable': 'true', 'created': '2026-01-22T16:14:37', 'last-modified': '2026-01-22T16:14:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.484338'} 2026-01-22 16:14:38,069 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-01-22 16:14:38,070 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-18099033 passed 2026-01-22 16:14:38,070 - DEBUG - ====Verifying policy data for ctest-left_vn-18099033 in API_Server ====== 2026-01-22 16:14:38,070 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:14:38,080 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:14:38,099 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:14:38,226 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c137fdd4-3a6a-46b8-895a-81d114b7925e 2026-01-22 16:14:38,237 - DEBUG - =>VN ctest-left_vn-18099033 has no policy to be verified 2026-01-22 16:14:38,237 - DEBUG - Verifying the vn in opserver 2026-01-22 16:14:38,237 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033 virtual network link through opserver 10.0.0.23 2026-01-22 16:14:38,237 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-01-22 16:14:38,304 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033?flat'} 2026-01-22 16:14:38,304 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033 virtual network link through opserver 10.0.0.240 2026-01-22 16:14:38,304 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-22 16:14:38,380 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033?flat'} 2026-01-22 16:14:38,380 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033 virtual network link through opserver 10.0.0.65 2026-01-22 16:14:38,380 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-01-22 16:14:38,459 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033?flat'} 2026-01-22 16:14:38,459 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033 is found in opserver 2026-01-22 16:14:38,486 - DEBUG - Do not have enough data to verify VN in agent 2026-01-22 16:14:38,500 - DEBUG - VRF ids for VN ctest-left_vn-18099033: {} 2026-01-22 16:14:38,914 - DEBUG - Response for create_network : {'network': {'id': '8ae6976b-47aa-44fd-9763-1a942e089725', 'name': 'ctest-right_vn-23086740', 'tenant_id': '2ffddae4633f40d48c4161f986385001', 'project_id': '2ffddae4633f40d48c4161f986385001', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-59331921', 'ctest-right_vn-23086740'], 'port_security_enabled': True, 'description': ''}} 2026-01-22 16:14:39,190 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b62882a0-e8bc-4f33-9983-90d0d777d453', 'name': '', 'tenant_id': '2ffddae4633f40d48c4161f986385001', 'network_id': '8ae6976b-47aa-44fd-9763-1a942e089725', 'ip_version': 4, 'cidr': '211.149.131.192/26', 'allocation_pools': [{'start': '211.149.131.194', 'end': '211.149.131.254'}], 'gateway_ip': '211.149.131.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '211.149.131.194', 'tags': [], 'project_id': '2ffddae4633f40d48c4161f986385001'}} 2026-01-22 16:14:39,225 - INFO - Created VN ctest-right_vn-23086740 2026-01-22 16:14:39,241 - DEBUG - VN ctest-right_vn-23086740 UUID is 8ae6976b-47aa-44fd-9763-1a942e089725 2026-01-22 16:14:39,330 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:14:39,345 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:14:39,357 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:14:39,465 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8ae6976b-47aa-44fd-9763-1a942e089725 2026-01-22 16:14:39,496 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8ae6976b-47aa-44fd-9763-1a942e089725 2026-01-22 16:14:39,507 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3a3eb228-32f1-436a-94a7-52e8761d21e0 2026-01-22 16:14:39,516 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3a3eb228-32f1-436a-94a7-52e8761d21e0 2026-01-22 16:14:39,527 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f17216e6-b0cd-4cdf-b923-0e83fa73483f 2026-01-22 16:14:39,536 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-01-22 16:14:39,537 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8ae6976b-47aa-44fd-9763-1a942e089725 2026-01-22 16:14:39,548 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3a3eb228-32f1-436a-94a7-52e8761d21e0 2026-01-22 16:14:39,569 - INFO - Verified VN network id 13 for VN 8ae6976b-47aa-44fd-9763-1a942e089725 2026-01-22 16:14:39,569 - INFO - Verifications in API Server for VN ctest-right_vn-23086740 passed 2026-01-22 16:14:39,569 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8ae6976b-47aa-44fd-9763-1a942e089725 2026-01-22 16:14:39,582 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3a3eb228-32f1-436a-94a7-52e8761d21e0 2026-01-22 16:14:39,590 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3a3eb228-32f1-436a-94a7-52e8761d21e0 2026-01-22 16:14:39,599 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f17216e6-b0cd-4cdf-b923-0e83fa73483f 2026-01-22 16:14:39,613 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-59331921', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10008853708897142013', 'uuid-lslong': '10908591946151270181'}, 'enable': 'true', 'created': '2026-01-22T16:14:38', 'last-modified': '2026-01-22T16:14:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.468780'} 2026-01-22 16:14:39,618 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-01-22 16:14:39,624 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-59331921', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10008853708897142013', 'uuid-lslong': '10908591946151270181'}, 'enable': 'true', 'created': '2026-01-22T16:14:38', 'last-modified': '2026-01-22T16:14:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.505893'} 2026-01-22 16:14:39,632 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-01-22 16:14:39,640 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-59331921', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10008853708897142013', 'uuid-lslong': '10908591946151270181'}, 'enable': 'true', 'created': '2026-01-22T16:14:38', 'last-modified': '2026-01-22T16:14:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.515836'} 2026-01-22 16:14:39,649 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-01-22 16:14:39,649 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-23086740 passed 2026-01-22 16:14:39,650 - DEBUG - ====Verifying policy data for ctest-right_vn-23086740 in API_Server ====== 2026-01-22 16:14:39,650 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:14:39,659 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:14:39,679 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:14:39,789 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8ae6976b-47aa-44fd-9763-1a942e089725 2026-01-22 16:14:39,799 - DEBUG - =>VN ctest-right_vn-23086740 has no policy to be verified 2026-01-22 16:14:39,799 - DEBUG - Verifying the vn in opserver 2026-01-22 16:14:39,799 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740 virtual network link through opserver 10.0.0.23 2026-01-22 16:14:39,799 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-01-22 16:14:39,881 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740?flat'} 2026-01-22 16:14:39,881 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740 virtual network link through opserver 10.0.0.240 2026-01-22 16:14:39,881 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-22 16:14:39,984 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740?flat'} 2026-01-22 16:14:39,984 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740 virtual network link through opserver 10.0.0.65 2026-01-22 16:14:39,984 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-01-22 16:14:40,076 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740?flat'} 2026-01-22 16:14:40,076 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740 is found in opserver 2026-01-22 16:14:40,098 - DEBUG - Do not have enough data to verify VN in agent 2026-01-22 16:14:40,110 - DEBUG - VRF ids for VN ctest-right_vn-23086740: {} 2026-01-22 16:14:40,179 - DEBUG - Services list from nova: [, , , ] 2026-01-22 16:14:41,532 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5062-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5062-2) 2026-01-22 16:14:42,982 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5062-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5062-1) 2026-01-22 16:14:42,983 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-54603140'] 2026-01-22 16:14:43,336 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-54603140'] created succesfully 2026-01-22 16:14:43,779 - DEBUG - Image by name cirros_in_net not found 2026-01-22 16:14:43,779 - DEBUG - Installing image cirros_in_net 2026-01-22 16:14:43,779 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2026-01-22 16:14:43,779 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2026-01-22 16:14:43,780 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2026-01-22 16:14:43,803 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2026-01-22 16:14:43,928 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2026-01-22 16:14:43,928 - DEBUG - Unzip image 2026-01-22 16:14:43,928 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2026-01-22 16:14:44,141 - DEBUG - Try to create image in user context 2026-01-22 16:14:44,387 - DEBUG - Image has been created in user context 2026-01-22 16:14:44,387 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2026-01-22 16:14:44,405 - DEBUG - Downloaded image has been removed 2026-01-22 16:14:44,421 - DEBUG - Uploaded image status = active 2026-01-22 16:14:45,796 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5062-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5062-2) 2026-01-22 16:14:45,796 - INFO - Waiting for VM ctest-pt_svm0-36821351 to be up.. 2026-01-22 16:14:45,856 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-01-22 16:14:51,007 - DEBUG - VM is in ACTIVE state now 2026-01-22 16:14:51,007 - INFO - VM name : ctest-pt_svm0-36821351 2026-01-22 16:14:51,117 - DEBUG - VM ctest-pt_svm0-36821351 ID is c1bcc2ed-8ed9-437f-8037-0936574c67dc 2026-01-22 16:14:51,145 - DEBUG - VM ctest-pt_svm0-36821351 launched on Node an-jenkins-deploy-platform-ansible-os-5062-2 2026-01-22 16:14:51,492 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/c1bcc2ed-8ed9-437f-8037-0936574c67dc 2026-01-22 16:14:51,829 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/c1bcc2ed-8ed9-437f-8037-0936574c67dc 2026-01-22 16:14:51,877 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/067685d0-6d9e-4343-81aa-6bd61362a7c1 2026-01-22 16:14:51,894 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/18ae5ad9-db3e-4e28-ba66-391f983f728a 2026-01-22 16:14:51,908 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/3691132b-1342-49b6-9802-5deef1f869ae 2026-01-22 16:14:55,230 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2026-01-22 16:14:55,230 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-36821351 failed! 2026-01-22 16:14:55,248 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995 is 59.144.238.65 and allocation pool is NOT set 2026-01-22 16:14:59,325 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2026-01-22 16:14:59,325 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-36821351 failed! 2026-01-22 16:14:59,347 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995 is 59.144.238.65 and allocation pool is NOT set 2026-01-22 16:15:03,422 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2026-01-22 16:15:03,422 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-36821351 failed! 2026-01-22 16:15:03,441 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995 is 59.144.238.65 and allocation pool is NOT set 2026-01-22 16:15:07,518 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2026-01-22 16:15:07,518 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-36821351 failed! 2026-01-22 16:15:07,544 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995 is 59.144.238.65 and allocation pool is NOT set 2026-01-22 16:15:11,615 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=10.4 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1007ms\r\nrtt min/avg/max/mdev = 10.423/10.423/10.423/0.000 ms') 2026-01-22 16:15:11,615 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-36821351 passed 2026-01-22 16:15:11,741 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:11,741 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-36821351, IP 59.144.238.67, Port 22 2026-01-22 16:15:11,800 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-22 16:15:11,917 - DEBUG - VM ctest-pt_svm0-36821351 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-22 16:15:16,918 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:16,918 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-36821351, IP 59.144.238.67, Port 22 2026-01-22 16:15:16,976 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-22 16:15:17,090 - DEBUG - VM ctest-pt_svm0-36821351 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-22 16:15:22,091 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:22,091 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-36821351, IP 59.144.238.67, Port 22 2026-01-22 16:15:22,158 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-22 16:15:22,260 - DEBUG - VM ctest-pt_svm0-36821351 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-22 16:15:27,260 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:27,260 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-36821351, IP 59.144.238.67, Port 22 2026-01-22 16:15:27,317 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-22 16:15:27,434 - DEBUG - VM ctest-pt_svm0-36821351 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-22 16:15:32,435 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:32,435 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-36821351, IP 59.144.238.67, Port 22 2026-01-22 16:15:32,593 - DEBUG - VM ctest-pt_svm0-36821351 is ready for SSH connections 2026-01-22 16:15:32,709 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:32,709 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-36821351, IP 59.144.238.67, Port 22 2026-01-22 16:15:32,874 - DEBUG - VM ctest-pt_svm0-36821351 is ready for SSH connections 2026-01-22 16:15:33,007 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:33,007 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-36821351, IP 59.144.238.67, Port 22 2026-01-22 16:15:33,178 - DEBUG - VM ctest-pt_svm0-36821351 is ready for SSH connections 2026-01-22 16:15:33,185 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-59331921', 'ctest-si-28515462'] 2026-01-22 16:15:34,097 - INFO - Waiting for VM ctest-left_vm-24379135 to be up.. 2026-01-22 16:15:34,279 - DEBUG - VM is in ACTIVE state now 2026-01-22 16:15:34,280 - INFO - VM name : ctest-left_vm-24379135 2026-01-22 16:15:34,436 - DEBUG - VM ctest-left_vm-24379135 ID is 9ac0170b-2e1d-4cba-9132-461e1f66aa6e 2026-01-22 16:15:34,437 - DEBUG - VM ctest-left_vm-24379135 launched on Node an-jenkins-deploy-platform-ansible-os-5062-2 2026-01-22 16:15:34,606 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/9ac0170b-2e1d-4cba-9132-461e1f66aa6e 2026-01-22 16:15:34,620 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/19fcef00-1132-46fa-ae65-75e5f0bda586 2026-01-22 16:15:35,884 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.72 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.397 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.397/1.558/2.720/1.161 ms') 2026-01-22 16:15:35,884 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-24379135 passed 2026-01-22 16:15:36,012 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:36,012 - DEBUG - Waiting to SSH to VM ctest-left_vm-24379135, IP 196.49.46.131, Port 22 2026-01-22 16:15:36,178 - DEBUG - VM ctest-left_vm-24379135 is ready for SSH connections 2026-01-22 16:15:36,178 - INFO - Waiting for VM ctest-right_vm-13705091 to be up.. 2026-01-22 16:15:36,266 - DEBUG - VM is in ACTIVE state now 2026-01-22 16:15:36,266 - INFO - VM name : ctest-right_vm-13705091 2026-01-22 16:15:36,354 - DEBUG - VM ctest-right_vm-13705091 ID is e51d3f15-71a8-4ef6-a405-77c782abe37a 2026-01-22 16:15:36,354 - DEBUG - VM ctest-right_vm-13705091 launched on Node an-jenkins-deploy-platform-ansible-os-5062-1 2026-01-22 16:15:36,454 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/e51d3f15-71a8-4ef6-a405-77c782abe37a 2026-01-22 16:15:36,467 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/b111867d-bdfa-46b9-9db7-f119063b33b5 2026-01-22 16:15:37,692 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.60 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.346 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.346/1.474/2.602/1.128 ms') 2026-01-22 16:15:37,692 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-right_vm-13705091 passed 2026-01-22 16:15:37,809 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:37,809 - DEBUG - Waiting to SSH to VM ctest-right_vm-13705091, IP 211.149.131.195, Port 22 2026-01-22 16:15:37,966 - DEBUG - VM ctest-right_vm-13705091 is ready for SSH connections 2026-01-22 16:15:37,974 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-59331921:ctest-si-28515462'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-01-22 16:15:38,391 - INFO - Attaching policy ctest-policy-60424250 to vn ctest-left_vn-18099033 2026-01-22 16:15:38,806 - INFO - Attaching policy ctest-policy-60424250 to vn ctest-right_vn-23086740 2026-01-22 16:15:39,205 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-54603140'] created succesfully 2026-01-22 16:15:39,479 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-59331921', 'ctest-si-28515462'] created succesfully 2026-01-22 16:15:39,479 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:15:39,490 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:15:39,508 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:15:39,624 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/50034e06-ec81-49a4-b07a-86884841b8db 2026-01-22 16:15:39,645 - DEBUG - SI 'ctest-si-28515462' has service template ref to ctest-service_template_1-54603140 2026-01-22 16:15:39,645 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:15:39,653 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:15:39,685 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:15:39,842 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/50034e06-ec81-49a4-b07a-86884841b8db 2026-01-22 16:15:39,858 - DEBUG - Requesting: http://10.0.0.23:8082/port-tuple/2c9a6d41-9a91-47b4-9617-79691cb17657 2026-01-22 16:15:39,867 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/067685d0-6d9e-4343-81aa-6bd61362a7c1 2026-01-22 16:15:39,886 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/18ae5ad9-db3e-4e28-ba66-391f983f728a 2026-01-22 16:15:39,903 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/3691132b-1342-49b6-9802-5deef1f869ae 2026-01-22 16:15:40,216 - DEBUG - VM is in ACTIVE state now 2026-01-22 16:15:40,801 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/c1bcc2ed-8ed9-437f-8037-0936574c67dc 2026-01-22 16:15:40,822 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/067685d0-6d9e-4343-81aa-6bd61362a7c1 2026-01-22 16:15:40,836 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/18ae5ad9-db3e-4e28-ba66-391f983f728a 2026-01-22 16:15:40,850 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/3691132b-1342-49b6-9802-5deef1f869ae 2026-01-22 16:15:40,870 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/00d30487-ff49-4e36-87df-84503a0bca9b 2026-01-22 16:15:40,890 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/68d086da-4eb3-4160-9184-e016c0be27c2 2026-01-22 16:15:40,902 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/b083b4be-2066-4723-8a28-058d5af3fe27 2026-01-22 16:15:40,914 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/123aeee1-5741-4e6b-b510-f23c474cafa5 2026-01-22 16:15:40,929 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/2f2ff05e-6674-4cd0-8a27-ff72986f730e 2026-01-22 16:15:40,938 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/e6477146-d504-4acc-8de0-36d47d8ebb9b 2026-01-22 16:15:40,947 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/41cba7ac-5ef2-434c-be3e-82b496bcd298 2026-01-22 16:15:40,962 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/48692c97-ef2a-4599-a85e-613aadaa891c 2026-01-22 16:15:40,973 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/cefbbcde-ea96-48dc-9547-7124e9e83291 2026-01-22 16:15:41,592 - DEBUG - VM is in ACTIVE state now 2026-01-22 16:15:41,592 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/c1bcc2ed-8ed9-437f-8037-0936574c67dc 2026-01-22 16:15:41,606 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/067685d0-6d9e-4343-81aa-6bd61362a7c1 2026-01-22 16:15:41,622 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/18ae5ad9-db3e-4e28-ba66-391f983f728a 2026-01-22 16:15:41,638 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/3691132b-1342-49b6-9802-5deef1f869ae 2026-01-22 16:15:42,858 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=1.32 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.505 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.505/0.913/1.322/0.408 ms') 2026-01-22 16:15:42,858 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-36821351 passed 2026-01-22 16:15:42,898 - DEBUG - VM ctest-pt_svm0-36821351 Tap interface: {'index': '5', 'name': 'tap3691132b-13', 'uuid': '3691132b-1342-49b6-9802-5deef1f869ae', 'vrf_name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033:ctest-left_vn-18099033', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033', 'vm_uuid': 'c1bcc2ed-8ed9-437f-8037-0936574c67dc', 'vm_name': 'ctest-pt_svm0-36821351', 'ip_addr': '196.49.46.132', 'mac_addr': '02:36:91:13:2b:13', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '34', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-59331921:3691132b-1342-49b6-9802-5deef1f869ae', 'sg_uuid_list': ['c6b9ede4-6973-4351-bdc0-fd77bc9c654b'], 'static_route_list': None, 'vm_project_uuid': '2ffddae4-633f-40d4-8c41-61f986385001', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '067685d0-6d9e-4343-81aa-6bd61362a7c1', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-22 16:15:42,898 - DEBUG - Agent 10.0.0.73 vrf name: default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033:ctest-left_vn-18099033 2026-01-22 16:15:42,907 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033:ctest-left_vn-18099033', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033', 'table_label': '-1', 'vxlan_id': '12', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.241:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-01-22 16:15:43,045 - DEBUG - VM ctest-pt_svm0-36821351 : Tap interface tap3691132b-13 is set to Active 2026-01-22 16:15:43,045 - DEBUG - Tap interface tap3691132b-13 detail : {'index': '5', 'name': 'tap3691132b-13', 'uuid': '3691132b-1342-49b6-9802-5deef1f869ae', 'vrf_name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033:ctest-left_vn-18099033', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033', 'vm_uuid': 'c1bcc2ed-8ed9-437f-8037-0936574c67dc', 'vm_name': 'ctest-pt_svm0-36821351', 'ip_addr': '196.49.46.132', 'mac_addr': '02:36:91:13:2b:13', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '34', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-59331921:3691132b-1342-49b6-9802-5deef1f869ae', 'sg_uuid_list': ['c6b9ede4-6973-4351-bdc0-fd77bc9c654b'], 'static_route_list': None, 'vm_project_uuid': '2ffddae4-633f-40d4-8c41-61f986385001', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '067685d0-6d9e-4343-81aa-6bd61362a7c1', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-22 16:15:43,212 - DEBUG - Starting Layer 2 verification in Agent 2026-01-22 16:15:43,226 - DEBUG - Layer 2 path is seen for VM MAC 02:36:91:13:2b:13 in agent 10.0.0.73 2026-01-22 16:15:43,226 - DEBUG - Active layer 2 route in agent is present for VMI tap3691132b-13 2026-01-22 16:15:43,226 - DEBUG - L2 label(43) matches bw route table and interface table 2026-01-22 16:15:43,242 - DEBUG - VN default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033 is found in Agent of node 10.0.0.73 2026-01-22 16:15:43,446 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033 is consistent in agent 10.0.0.73 2026-01-22 16:15:43,446 - DEBUG - Route for VM IP ['196.49.46.132'] is consistent in agent 10.0.0.73 2026-01-22 16:15:43,447 - DEBUG - VN default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033 verification for VM ctest-pt_svm0-36821351 in Agent 10.0.0.73 passed 2026-01-22 16:15:43,636 - DEBUG - Starting all layer 2 verification in agent 10.0.0.73 2026-01-22 16:15:43,649 - DEBUG - Route for VM MAC 02:36:91:13:2b:13 is consistent in agent 10.0.0.73 2026-01-22 16:15:43,673 - DEBUG - VM ctest-pt_svm0-36821351 Tap interface: {'index': '4', 'name': 'tap18ae5ad9-db', 'uuid': '18ae5ad9-db3e-4e28-ba66-391f983f728a', 'vrf_name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995:ctest-mgmt_vn-22262995', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '34', 'l2_label': '38', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995', 'vm_uuid': 'c1bcc2ed-8ed9-437f-8037-0936574c67dc', 'vm_name': 'ctest-pt_svm0-36821351', 'ip_addr': '59.144.238.67', 'mac_addr': '02:18:ae:5a:d9:db', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '33', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-59331921:18ae5ad9-db3e-4e28-ba66-391f983f728a', 'sg_uuid_list': ['c6b9ede4-6973-4351-bdc0-fd77bc9c654b'], 'static_route_list': None, 'vm_project_uuid': '2ffddae4-633f-40d4-8c41-61f986385001', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-22 16:15:43,673 - DEBUG - Agent 10.0.0.73 vrf name: default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995:ctest-mgmt_vn-22262995 2026-01-22 16:15:43,679 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995:ctest-mgmt_vn-22262995', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995', 'table_label': '-1', 'vxlan_id': '11', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.241:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-01-22 16:15:43,820 - DEBUG - VM ctest-pt_svm0-36821351 : Tap interface tap18ae5ad9-db is set to Active 2026-01-22 16:15:43,821 - DEBUG - Tap interface tap18ae5ad9-db detail : {'index': '4', 'name': 'tap18ae5ad9-db', 'uuid': '18ae5ad9-db3e-4e28-ba66-391f983f728a', 'vrf_name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995:ctest-mgmt_vn-22262995', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '34', 'l2_label': '38', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995', 'vm_uuid': 'c1bcc2ed-8ed9-437f-8037-0936574c67dc', 'vm_name': 'ctest-pt_svm0-36821351', 'ip_addr': '59.144.238.67', 'mac_addr': '02:18:ae:5a:d9:db', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '33', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-59331921:18ae5ad9-db3e-4e28-ba66-391f983f728a', 'sg_uuid_list': ['c6b9ede4-6973-4351-bdc0-fd77bc9c654b'], 'static_route_list': None, 'vm_project_uuid': '2ffddae4-633f-40d4-8c41-61f986385001', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-22 16:15:43,981 - DEBUG - Starting Layer 2 verification in Agent 2026-01-22 16:15:43,993 - DEBUG - Layer 2 path is seen for VM MAC 02:18:ae:5a:d9:db in agent 10.0.0.73 2026-01-22 16:15:43,993 - DEBUG - Active layer 2 route in agent is present for VMI tap18ae5ad9-db 2026-01-22 16:15:43,993 - DEBUG - L2 label(38) matches bw route table and interface table 2026-01-22 16:15:44,006 - DEBUG - VN default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995 is found in Agent of node 10.0.0.73 2026-01-22 16:15:44,196 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995 is consistent in agent 10.0.0.73 2026-01-22 16:15:44,196 - DEBUG - Route for VM IP ['59.144.238.67'] is consistent in agent 10.0.0.73 2026-01-22 16:15:44,196 - DEBUG - VN default-domain:ctest-TestSvcRegr-59331921:ctest-mgmt_vn-22262995 verification for VM ctest-pt_svm0-36821351 in Agent 10.0.0.73 passed 2026-01-22 16:15:44,385 - DEBUG - Starting all layer 2 verification in agent 10.0.0.73 2026-01-22 16:15:44,399 - DEBUG - Route for VM MAC 02:18:ae:5a:d9:db is consistent in agent 10.0.0.73 2026-01-22 16:15:44,426 - DEBUG - VM ctest-pt_svm0-36821351 Tap interface: {'index': '6', 'name': 'tap067685d0-6d', 'uuid': '067685d0-6d9e-4343-81aa-6bd61362a7c1', 'vrf_name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740:ctest-right_vn-23086740', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740', 'vm_uuid': 'c1bcc2ed-8ed9-437f-8037-0936574c67dc', 'vm_name': 'ctest-pt_svm0-36821351', 'ip_addr': '211.149.131.196', 'mac_addr': '02:06:76:85:d0:6d', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '35', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-59331921:067685d0-6d9e-4343-81aa-6bd61362a7c1', 'sg_uuid_list': ['c6b9ede4-6973-4351-bdc0-fd77bc9c654b'], 'static_route_list': None, 'vm_project_uuid': '2ffddae4-633f-40d4-8c41-61f986385001', 'admin_state': 'Enabled', 'flow_key_idx': '55', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '3691132b-1342-49b6-9802-5deef1f869ae', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-22 16:15:44,427 - DEBUG - Agent 10.0.0.73 vrf name: default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740:ctest-right_vn-23086740 2026-01-22 16:15:44,434 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740:ctest-right_vn-23086740', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.241:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-01-22 16:15:44,589 - DEBUG - VM ctest-pt_svm0-36821351 : Tap interface tap067685d0-6d is set to Active 2026-01-22 16:15:44,589 - DEBUG - Tap interface tap067685d0-6d detail : {'index': '6', 'name': 'tap067685d0-6d', 'uuid': '067685d0-6d9e-4343-81aa-6bd61362a7c1', 'vrf_name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740:ctest-right_vn-23086740', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740', 'vm_uuid': 'c1bcc2ed-8ed9-437f-8037-0936574c67dc', 'vm_name': 'ctest-pt_svm0-36821351', 'ip_addr': '211.149.131.196', 'mac_addr': '02:06:76:85:d0:6d', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '35', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-59331921:067685d0-6d9e-4343-81aa-6bd61362a7c1', 'sg_uuid_list': ['c6b9ede4-6973-4351-bdc0-fd77bc9c654b'], 'static_route_list': None, 'vm_project_uuid': '2ffddae4-633f-40d4-8c41-61f986385001', 'admin_state': 'Enabled', 'flow_key_idx': '55', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '3691132b-1342-49b6-9802-5deef1f869ae', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-22 16:15:44,746 - DEBUG - Starting Layer 2 verification in Agent 2026-01-22 16:15:44,757 - DEBUG - Layer 2 path is seen for VM MAC 02:06:76:85:d0:6d in agent 10.0.0.73 2026-01-22 16:15:44,758 - DEBUG - Active layer 2 route in agent is present for VMI tap067685d0-6d 2026-01-22 16:15:44,758 - DEBUG - L2 label(48) matches bw route table and interface table 2026-01-22 16:15:44,763 - DEBUG - VN default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740 is found in Agent of node 10.0.0.130 2026-01-22 16:15:44,953 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740 is consistent in agent 10.0.0.130 2026-01-22 16:15:44,954 - DEBUG - Route for VM IP ['211.149.131.196'] is consistent in agent 10.0.0.130 2026-01-22 16:15:44,954 - DEBUG - VN default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740 verification for VM ctest-pt_svm0-36821351 in Agent 10.0.0.130 passed 2026-01-22 16:15:45,113 - DEBUG - Starting all layer 2 verification in agent 10.0.0.130 2026-01-22 16:15:45,123 - DEBUG - Route for VM MAC 02:06:76:85:d0:6d is consistent in agent 10.0.0.130 2026-01-22 16:15:45,129 - DEBUG - VN default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740 is found in Agent of node 10.0.0.73 2026-01-22 16:15:45,314 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740 is consistent in agent 10.0.0.73 2026-01-22 16:15:45,315 - DEBUG - Route for VM IP ['211.149.131.196'] is consistent in agent 10.0.0.73 2026-01-22 16:15:45,315 - DEBUG - VN default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740 verification for VM ctest-pt_svm0-36821351 in Agent 10.0.0.73 passed 2026-01-22 16:15:45,484 - DEBUG - Starting all layer 2 verification in agent 10.0.0.73 2026-01-22 16:15:45,496 - DEBUG - Route for VM MAC 02:06:76:85:d0:6d is consistent in agent 10.0.0.73 2026-01-22 16:15:45,496 - INFO - VM ctest-pt_svm0-36821351 verifications in Compute nodes passed 2026-01-22 16:15:45,496 - DEBUG - The SVMs in the SI are : [] 2026-01-22 16:15:45,496 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c1bcc2ed-8ed9-437f-8037-0936574c67dc 2026-01-22 16:15:45,513 - DEBUG - Service VM for SI 'ctest-si-28515462' is launched 2026-01-22 16:15:45,513 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:15:45,521 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:15:45,535 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:15:45,647 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/50034e06-ec81-49a4-b07a-86884841b8db 2026-01-22 16:15:45,659 - DEBUG - SI ctest-si-28515462 has Port Tuple: ['ctest-port_tuple-21646941'] 2026-01-22 16:15:45,686 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-59331921:ctest-left_vn-18099033 2026-01-22 16:15:45,760 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-59331921:ctest-right_vn-23086740 2026-01-22 16:15:45,847 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:45,859 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:45,859 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:45,866 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:45,866 - INFO - Route to 211.149.131.195 seen in VRF:5 on an-jenkins-deploy-platform-ansible-os-5062-2, and SI ctest-si-28515462 is seen as the NH 2026-01-22 16:15:45,955 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:45,965 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:45,965 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:45,971 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:45,971 - INFO - Route to 196.49.46.131 seen in VRF:6 on an-jenkins-deploy-platform-ansible-os-5062-2, and SI ctest-si-28515462 is seen as the NH 2026-01-22 16:15:45,971 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:45,971 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-22 16:15:45,971 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 211.149.131.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2026-01-22 16:15:45,971 - DEBUG - ping -s 56 -c 3 -W 1 211.149.131.195 2026-01-22 16:15:49,951 - DEBUG - PING 211.149.131.195 (211.149.131.195): 56 data bytes 64 bytes from 211.149.131.195: seq=0 ttl=61 time=10.976 ms 64 bytes from 211.149.131.195: seq=1 ttl=61 time=2.386 ms 64 bytes from 211.149.131.195: seq=2 ttl=61 time=2.234 ms --- 211.149.131.195 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 2.234/5.198/10.976 ms 2026-01-22 16:15:49,951 - INFO - Ping to IP 211.149.131.195 from VM ctest-left_vm-24379135 passed 2026-01-22 16:15:49,952 - INFO - Dettaching policy ctest-policy-60424250 from vn ctest-right_vn-23086740 2026-01-22 16:15:50,162 - INFO - Dettaching policy ctest-policy-60424250 from vn ctest-left_vn-18099033 2026-01-22 16:15:50,473 - INFO - Deleted policy ctest-policy-60424250 2026-01-22 16:15:50,473 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-59331921', 'ctest-si-28515462'] 2026-01-22 16:15:50,615 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-59331921', 'ctest-si-28515462'] 2026-01-22 16:15:50,615 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:15:50,624 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:15:50,657 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:15:50,772 - DEBUG - Service instance ctest-si-28515462 removed from api server 2026-01-22 16:15:50,772 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c1bcc2ed-8ed9-437f-8037-0936574c67dc 2026-01-22 16:15:50,786 - DEBUG - All Service VMs unlinked from SI ctest-si-28515462 2026-01-22 16:15:50,793 - DEBUG - 0 svc intances found in all projects. They are [] 2026-01-22 16:15:50,793 - DEBUG - 0 svc intances found in current project. They are [] 2026-01-22 16:15:50,841 - DEBUG - 0 svc intances found in all projects. They are [] 2026-01-22 16:15:50,841 - DEBUG - 0 svc intances found in current project. They are [] 2026-01-22 16:15:50,841 - INFO - Deleting VM ctest-pt_svm0-36821351 2026-01-22 16:15:50,958 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-54603140'] 2026-01-22 16:15:51,090 - INFO - Service template: ['default-domain', 'ctest-service_template_1-54603140'] deleted successfully. 2026-01-22 16:15:51,090 - INFO - Deleting VM ctest-right_vm-13705091 2026-01-22 16:15:51,195 - INFO - Deleting VM ctest-left_vm-24379135 2026-01-22 16:15:51,270 - INFO - Deleting VN ctest-right_vn-23086740 2026-01-22 16:15:51,323 - DEBUG - VN 8ae6976b-47aa-44fd-9763-1a942e089725 still in use: Unable to complete operation on network 8ae6976b-47aa-44fd-9763-1a942e089725. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-d7081c48-92ef-4646-a52d-a5c0822a948f'] 2026-01-22 16:15:51,323 - WARNING - Deleting VN ctest-right_vn-23086740 failed..Will retry 2026-01-22 16:15:53,509 - DEBUG - Response for deleting network () 2026-01-22 16:15:53,510 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3a3eb228-32f1-436a-94a7-52e8761d21e0 2026-01-22 16:15:53,516 - DEBUG - Response Code: 404 2026-01-22 16:15:53,516 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:15:53,522 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:15:53,549 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:15:53,645 - INFO - Validated that VN ctest-right_vn-23086740 is not found in API Server 2026-01-22 16:15:53,656 - DEBUG - VN ctest-right_vn-23086740 is not present in Agent 10.0.0.130 2026-01-22 16:15:53,665 - DEBUG - VN ctest-right_vn-23086740 is not present in Agent 10.0.0.73 2026-01-22 16:15:53,665 - INFO - Validated that VN ctest-right_vn-23086740 is not in any agent 2026-01-22 16:15:53,696 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-23086740 info 2026-01-22 16:15:53,697 - INFO - Deleting VN ctest-left_vn-18099033 2026-01-22 16:15:53,862 - DEBUG - Response for deleting network () 2026-01-22 16:15:53,862 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b103d803-ee9c-48db-9f6a-d342bf0d6ded 2026-01-22 16:15:53,868 - DEBUG - Response Code: 404 2026-01-22 16:15:53,868 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:15:53,874 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:15:53,935 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:15:54,040 - INFO - Validated that VN ctest-left_vn-18099033 is not found in API Server 2026-01-22 16:15:54,050 - DEBUG - VN ctest-left_vn-18099033 is not present in Agent 10.0.0.130 2026-01-22 16:15:54,061 - DEBUG - VN ctest-left_vn-18099033 is not present in Agent 10.0.0.73 2026-01-22 16:15:54,061 - INFO - Validated that VN ctest-left_vn-18099033 is not in any agent 2026-01-22 16:15:54,093 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-18099033 info 2026-01-22 16:15:54,093 - INFO - Deleting VN ctest-mgmt_vn-22262995 2026-01-22 16:15:54,275 - DEBUG - Response for deleting network () 2026-01-22 16:15:54,275 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/1a1f8a0e-e125-4acf-be29-c54c42211aec 2026-01-22 16:15:54,280 - DEBUG - Response Code: 404 2026-01-22 16:15:54,280 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-01-22 16:15:54,291 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6 2026-01-22 16:15:54,308 - DEBUG - Requesting: http://10.0.0.23:8082/project/2ffddae4-633f-40d4-8c41-61f986385001 2026-01-22 16:15:54,405 - INFO - Validated that VN ctest-mgmt_vn-22262995 is not found in API Server 2026-01-22 16:15:54,417 - DEBUG - VN ctest-mgmt_vn-22262995 is not present in Agent 10.0.0.130 2026-01-22 16:15:54,431 - DEBUG - VN ctest-mgmt_vn-22262995 is not present in Agent 10.0.0.73 2026-01-22 16:15:54,431 - INFO - Validated that VN ctest-mgmt_vn-22262995 is not in any agent 2026-01-22 16:15:54,472 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-22262995 info 2026-01-22 16:15:55,760 - DEBUG - No XMPP flaps were noticed during the test 2026-01-22 16:15:55,760 - INFO -
2026-01-22 16:15:55,760 - INFO - END TEST : test_svc_in_network_datapath : PASSED[0:01:23]
2026-01-22 16:15:55,760 - INFO - -------------------------------------------------------------------------------- 2026-01-22 16:15:56,529 - INFO - Deleted project: ctest-TestSvcRegr-59331921, ID : 2ffddae4-633f-40d4-8c41-61f986385001