2025-09-16 11:42:06,984 - INFO - Domain Default found not creating 2025-09-16 11:42:07,132 - INFO - Project ctest-TestSvcRegr-45130465 not found, creating it 2025-09-16 11:42:07,569 - INFO - Created Project:ctest-TestSvcRegr-45130465, ID : 86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:42:08,962 - INFO - ================================================================================ 2025-09-16 11:42:08,963 - INFO - STARTING TEST : test_svc_in_network_datapath 2025-09-16 11:42:09,219 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.17': '0'}} with 2025-09-16 11:42:09,219 - INFO - Initial checks done. Running the testcase now 2025-09-16 11:42:09,219 - INFO - 2025-09-16 11:42:09,763 - DEBUG - Response for create_network : {'network': {'id': '4a4ed30b-7f33-4d99-ad5f-808b5c6fe20c', 'name': 'ctest-mgmt_vn-47375977', 'tenant_id': '86465022529b4c1a9c0f6d7ff3e142b4', 'project_id': '86465022529b4c1a9c0f6d7ff3e142b4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-45130465', 'ctest-mgmt_vn-47375977'], 'port_security_enabled': True, 'description': ''}} 2025-09-16 11:42:09,939 - DEBUG - Response for create_subnet : {'subnet': {'id': '20c7e919-384a-459b-b541-8062ec16b71d', 'name': '', 'tenant_id': '86465022529b4c1a9c0f6d7ff3e142b4', 'network_id': '4a4ed30b-7f33-4d99-ad5f-808b5c6fe20c', 'ip_version': 4, 'cidr': '112.167.125.192/26', 'allocation_pools': [{'start': '112.167.125.194', 'end': '112.167.125.254'}], 'gateway_ip': '112.167.125.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '112.167.125.194', 'tags': [], 'project_id': '86465022529b4c1a9c0f6d7ff3e142b4'}} 2025-09-16 11:42:09,957 - INFO - Created VN ctest-mgmt_vn-47375977 2025-09-16 11:42:10,014 - DEBUG - VN ctest-mgmt_vn-47375977 UUID is 4a4ed30b-7f33-4d99-ad5f-808b5c6fe20c 2025-09-16 11:42:10,124 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:42:10,422 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:42:10,456 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:42:10,467 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:42:10,548 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4a4ed30b-7f33-4d99-ad5f-808b5c6fe20c 2025-09-16 11:42:10,558 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4a4ed30b-7f33-4d99-ad5f-808b5c6fe20c 2025-09-16 11:42:10,565 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3cc163e7-b82e-433c-814c-8c1cdb222289 2025-09-16 11:42:10,571 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3cc163e7-b82e-433c-814c-8c1cdb222289 2025-09-16 11:42:10,578 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1d2fd5aa-b3c7-44fc-ab45-1677c7aeeeb3 2025-09-16 11:42:10,585 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-16 11:42:10,585 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4a4ed30b-7f33-4d99-ad5f-808b5c6fe20c 2025-09-16 11:42:10,596 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3cc163e7-b82e-433c-814c-8c1cdb222289 2025-09-16 11:42:10,616 - INFO - Verified VN network id 11 for VN 4a4ed30b-7f33-4d99-ad5f-808b5c6fe20c 2025-09-16 11:42:10,616 - INFO - Verifications in API Server for VN ctest-mgmt_vn-47375977 passed 2025-09-16 11:42:10,616 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4a4ed30b-7f33-4d99-ad5f-808b5c6fe20c 2025-09-16 11:42:10,625 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3cc163e7-b82e-433c-814c-8c1cdb222289 2025-09-16 11:42:10,630 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3cc163e7-b82e-433c-814c-8c1cdb222289 2025-09-16 11:42:10,635 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1d2fd5aa-b3c7-44fc-ab45-1677c7aeeeb3 2025-09-16 11:42:10,646 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-45130465', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5354449053322268057', 'uuid-lslong': '12492845227388690956'}, 'enable': 'true', 'created': '2025-09-16T11:42:09', 'last-modified': '2025-09-16T11:42:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.739847'} 2025-09-16 11:42:10,651 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-16 11:42:10,651 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-47375977 passed 2025-09-16 11:42:10,651 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-47375977 in API_Server ====== 2025-09-16 11:42:10,651 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:42:10,658 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:42:10,677 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:42:10,772 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4a4ed30b-7f33-4d99-ad5f-808b5c6fe20c 2025-09-16 11:42:10,782 - DEBUG - =>VN ctest-mgmt_vn-47375977 has no policy to be verified 2025-09-16 11:42:10,782 - DEBUG - Verifying the vn in opserver 2025-09-16 11:42:10,782 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977 virtual network link through opserver 10.0.0.38 2025-09-16 11:42:10,782 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-16 11:42:11,100 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-16 11:42:11,151 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977?flat'} 2025-09-16 11:42:11,151 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977 is found in opserver 2025-09-16 11:42:11,159 - DEBUG - Do not have enough data to verify VN in agent 2025-09-16 11:42:11,164 - DEBUG - VRF ids for VN ctest-mgmt_vn-47375977: {} 2025-09-16 11:42:11,339 - DEBUG - Response for create_network : {'network': {'id': '33db8995-e2c3-4cc8-b443-f7e03ffbc594', 'name': 'ctest-left_vn-83728592', 'tenant_id': '86465022529b4c1a9c0f6d7ff3e142b4', 'project_id': '86465022529b4c1a9c0f6d7ff3e142b4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-45130465', 'ctest-left_vn-83728592'], 'port_security_enabled': True, 'description': ''}} 2025-09-16 11:42:11,517 - DEBUG - Response for create_subnet : {'subnet': {'id': '1c638dce-2c86-458f-804d-bd92aa057c72', 'name': '', 'tenant_id': '86465022529b4c1a9c0f6d7ff3e142b4', 'network_id': '33db8995-e2c3-4cc8-b443-f7e03ffbc594', 'ip_version': 4, 'cidr': '213.77.104.128/26', 'allocation_pools': [{'start': '213.77.104.130', 'end': '213.77.104.190'}], 'gateway_ip': '213.77.104.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '213.77.104.130', 'tags': [], 'project_id': '86465022529b4c1a9c0f6d7ff3e142b4'}} 2025-09-16 11:42:11,535 - INFO - Created VN ctest-left_vn-83728592 2025-09-16 11:42:11,586 - DEBUG - VN ctest-left_vn-83728592 UUID is 33db8995-e2c3-4cc8-b443-f7e03ffbc594 2025-09-16 11:42:11,696 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:42:11,701 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:42:11,713 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:42:11,781 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/33db8995-e2c3-4cc8-b443-f7e03ffbc594 2025-09-16 11:42:11,791 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/33db8995-e2c3-4cc8-b443-f7e03ffbc594 2025-09-16 11:42:11,799 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/79c259ad-f86c-4c59-bb80-e5638b610e7d 2025-09-16 11:42:11,805 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/79c259ad-f86c-4c59-bb80-e5638b610e7d 2025-09-16 11:42:11,810 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/e1d50a46-7c72-460b-b106-10fb6f4918a7 2025-09-16 11:42:11,815 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-16 11:42:11,815 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/33db8995-e2c3-4cc8-b443-f7e03ffbc594 2025-09-16 11:42:11,823 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/79c259ad-f86c-4c59-bb80-e5638b610e7d 2025-09-16 11:42:11,835 - INFO - Verified VN network id 12 for VN 33db8995-e2c3-4cc8-b443-f7e03ffbc594 2025-09-16 11:42:11,835 - INFO - Verifications in API Server for VN ctest-left_vn-83728592 passed 2025-09-16 11:42:11,835 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/33db8995-e2c3-4cc8-b443-f7e03ffbc594 2025-09-16 11:42:11,843 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/79c259ad-f86c-4c59-bb80-e5638b610e7d 2025-09-16 11:42:11,849 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/79c259ad-f86c-4c59-bb80-e5638b610e7d 2025-09-16 11:42:11,856 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/e1d50a46-7c72-460b-b106-10fb6f4918a7 2025-09-16 11:42:11,866 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-45130465', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3736731592681540808', 'uuid-lslong': '12989498292784842132'}, 'enable': 'true', 'created': '2025-09-16T11:42:11', 'last-modified': '2025-09-16T11:42:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.371117'} 2025-09-16 11:42:11,871 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-16 11:42:11,871 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-83728592 passed 2025-09-16 11:42:11,871 - DEBUG - ====Verifying policy data for ctest-left_vn-83728592 in API_Server ====== 2025-09-16 11:42:11,871 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:42:11,876 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:42:11,887 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:42:11,953 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/33db8995-e2c3-4cc8-b443-f7e03ffbc594 2025-09-16 11:42:11,966 - DEBUG - =>VN ctest-left_vn-83728592 has no policy to be verified 2025-09-16 11:42:11,966 - DEBUG - Verifying the vn in opserver 2025-09-16 11:42:11,966 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592 virtual network link through opserver 10.0.0.38 2025-09-16 11:42:11,966 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-16 11:42:11,976 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592?flat'} 2025-09-16 11:42:11,976 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592 is found in opserver 2025-09-16 11:42:11,984 - DEBUG - Do not have enough data to verify VN in agent 2025-09-16 11:42:11,988 - DEBUG - VRF ids for VN ctest-left_vn-83728592: {} 2025-09-16 11:42:12,162 - DEBUG - Response for create_network : {'network': {'id': '6059b199-34eb-42fd-b586-2d7b24aaef82', 'name': 'ctest-right_vn-36685918', 'tenant_id': '86465022529b4c1a9c0f6d7ff3e142b4', 'project_id': '86465022529b4c1a9c0f6d7ff3e142b4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-45130465', 'ctest-right_vn-36685918'], 'port_security_enabled': True, 'description': ''}} 2025-09-16 11:42:12,329 - DEBUG - Response for create_subnet : {'subnet': {'id': '069b87d1-65f8-41b7-9123-42b2232dd788', 'name': '', 'tenant_id': '86465022529b4c1a9c0f6d7ff3e142b4', 'network_id': '6059b199-34eb-42fd-b586-2d7b24aaef82', 'ip_version': 4, 'cidr': '115.78.195.192/26', 'allocation_pools': [{'start': '115.78.195.194', 'end': '115.78.195.254'}], 'gateway_ip': '115.78.195.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '115.78.195.194', 'tags': [], 'project_id': '86465022529b4c1a9c0f6d7ff3e142b4'}} 2025-09-16 11:42:12,346 - INFO - Created VN ctest-right_vn-36685918 2025-09-16 11:42:12,398 - DEBUG - VN ctest-right_vn-36685918 UUID is 6059b199-34eb-42fd-b586-2d7b24aaef82 2025-09-16 11:42:12,501 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:42:12,505 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:42:12,514 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:42:12,581 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6059b199-34eb-42fd-b586-2d7b24aaef82 2025-09-16 11:42:12,589 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6059b199-34eb-42fd-b586-2d7b24aaef82 2025-09-16 11:42:12,598 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3c7c21ae-7cfb-40bf-a4e8-170e38ac5094 2025-09-16 11:42:12,604 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3c7c21ae-7cfb-40bf-a4e8-170e38ac5094 2025-09-16 11:42:12,610 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/f56949d0-db07-4ca0-af44-c5fe179ca89a 2025-09-16 11:42:12,615 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-16 11:42:12,615 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6059b199-34eb-42fd-b586-2d7b24aaef82 2025-09-16 11:42:12,622 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3c7c21ae-7cfb-40bf-a4e8-170e38ac5094 2025-09-16 11:42:12,633 - INFO - Verified VN network id 13 for VN 6059b199-34eb-42fd-b586-2d7b24aaef82 2025-09-16 11:42:12,633 - INFO - Verifications in API Server for VN ctest-right_vn-36685918 passed 2025-09-16 11:42:12,633 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6059b199-34eb-42fd-b586-2d7b24aaef82 2025-09-16 11:42:12,642 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3c7c21ae-7cfb-40bf-a4e8-170e38ac5094 2025-09-16 11:42:12,649 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3c7c21ae-7cfb-40bf-a4e8-170e38ac5094 2025-09-16 11:42:12,654 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/f56949d0-db07-4ca0-af44-c5fe179ca89a 2025-09-16 11:42:12,665 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-45130465', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6942775572144276221', 'uuid-lslong': '13080192174663593858'}, 'enable': 'true', 'created': '2025-09-16T11:42:12', 'last-modified': '2025-09-16T11:42:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.365034'} 2025-09-16 11:42:12,671 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-16 11:42:12,672 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-36685918 passed 2025-09-16 11:42:12,672 - DEBUG - ====Verifying policy data for ctest-right_vn-36685918 in API_Server ====== 2025-09-16 11:42:12,672 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:42:12,678 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:42:12,689 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:42:12,760 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6059b199-34eb-42fd-b586-2d7b24aaef82 2025-09-16 11:42:12,768 - DEBUG - =>VN ctest-right_vn-36685918 has no policy to be verified 2025-09-16 11:42:12,768 - DEBUG - Verifying the vn in opserver 2025-09-16 11:42:12,768 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918 virtual network link through opserver 10.0.0.38 2025-09-16 11:42:12,768 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-16 11:42:12,778 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918?flat'} 2025-09-16 11:42:12,778 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918 is found in opserver 2025-09-16 11:42:12,786 - DEBUG - Do not have enough data to verify VN in agent 2025-09-16 11:42:12,790 - DEBUG - VRF ids for VN ctest-right_vn-36685918: {} 2025-09-16 11:42:12,842 - DEBUG - Services list from nova: [, , ] 2025-09-16 11:42:13,849 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4121-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4121-1) 2025-09-16 11:42:15,007 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4121-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4121-1) 2025-09-16 11:42:15,007 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-88379369'] 2025-09-16 11:42:15,382 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-88379369'] created succesfully 2025-09-16 11:42:15,734 - DEBUG - Image by name cirros_in_net not found 2025-09-16 11:42:15,734 - DEBUG - Installing image cirros_in_net 2025-09-16 11:42:15,734 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-09-16 11:42:15,734 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-09-16 11:42:15,734 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-09-16 11:42:15,753 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2025-09-16 11:42:15,963 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2025-09-16 11:42:15,963 - DEBUG - Unzip image 2025-09-16 11:42:15,963 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2025-09-16 11:42:16,134 - DEBUG - Try to create image in user context 2025-09-16 11:42:16,390 - DEBUG - Image has been created in user context 2025-09-16 11:42:16,390 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2025-09-16 11:42:16,408 - DEBUG - Downloaded image has been removed 2025-09-16 11:42:16,423 - DEBUG - Uploaded image status = active 2025-09-16 11:42:17,595 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4121-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4121-1) 2025-09-16 11:42:17,595 - INFO - Waiting for VM ctest-pt_svm0-89437606 to be up.. 2025-09-16 11:42:17,634 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-16 11:42:22,715 - DEBUG - VM is in ACTIVE state now 2025-09-16 11:42:22,715 - INFO - VM name : ctest-pt_svm0-89437606 2025-09-16 11:42:22,792 - DEBUG - VM ctest-pt_svm0-89437606 ID is d513a6e8-567a-4a29-9518-c7a87254e34b 2025-09-16 11:42:22,811 - DEBUG - VM ctest-pt_svm0-89437606 launched on Node cn-jenkins-deploy-platform-ansible-os-4121-1 2025-09-16 11:42:23,038 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d513a6e8-567a-4a29-9518-c7a87254e34b 2025-09-16 11:42:23,046 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/2ac6742a-b653-4131-a44f-a669d3b28664 2025-09-16 11:42:23,056 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/2ae686be-66d4-4843-8f90-f74330fb00e8 2025-09-16 11:42:23,068 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/b7c7a9ee-031f-416d-84e7-7de3b1a4c165 2025-09-16 11:42:26,348 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2025-09-16 11:42:26,348 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-89437606 failed! 2025-09-16 11:42:26,402 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977 is 112.167.125.193 and allocation pool is NOT set 2025-09-16 11:42:30,478 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-09-16 11:42:30,478 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-89437606 failed! 2025-09-16 11:42:30,530 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977 is 112.167.125.193 and allocation pool is NOT set 2025-09-16 11:42:34,609 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-09-16 11:42:34,609 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-89437606 failed! 2025-09-16 11:42:34,662 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977 is 112.167.125.193 and allocation pool is NOT set 2025-09-16 11:42:38,739 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=11.6 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1019ms\r\nrtt min/avg/max/mdev = 11.556/11.556/11.556/0.000 ms') 2025-09-16 11:42:38,739 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-89437606 passed 2025-09-16 11:42:38,890 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:42:38,890 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-89437606, IP 112.167.125.195, Port 22 2025-09-16 11:42:38,956 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-16 11:42:39,039 - DEBUG - VM ctest-pt_svm0-89437606 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-16 11:42:44,040 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:42:44,040 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-89437606, IP 112.167.125.195, Port 22 2025-09-16 11:42:44,098 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-16 11:42:44,190 - DEBUG - VM ctest-pt_svm0-89437606 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-16 11:42:49,191 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:42:49,191 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-89437606, IP 112.167.125.195, Port 22 2025-09-16 11:42:49,256 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-16 11:42:49,336 - DEBUG - VM ctest-pt_svm0-89437606 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-16 11:42:54,337 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:42:54,337 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-89437606, IP 112.167.125.195, Port 22 2025-09-16 11:42:54,404 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-16 11:42:54,482 - DEBUG - VM ctest-pt_svm0-89437606 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-16 11:42:59,483 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:42:59,483 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-89437606, IP 112.167.125.195, Port 22 2025-09-16 11:42:59,642 - DEBUG - VM ctest-pt_svm0-89437606 is ready for SSH connections 2025-09-16 11:42:59,790 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:42:59,790 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-89437606, IP 112.167.125.195, Port 22 2025-09-16 11:42:59,941 - DEBUG - VM ctest-pt_svm0-89437606 is ready for SSH connections 2025-09-16 11:43:00,090 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:00,090 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-89437606, IP 112.167.125.195, Port 22 2025-09-16 11:43:00,251 - DEBUG - VM ctest-pt_svm0-89437606 is ready for SSH connections 2025-09-16 11:43:00,257 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-45130465', 'ctest-si-55605488'] 2025-09-16 11:43:01,118 - INFO - Waiting for VM ctest-left_vm-41033405 to be up.. 2025-09-16 11:43:01,193 - DEBUG - VM is in ACTIVE state now 2025-09-16 11:43:01,193 - INFO - VM name : ctest-left_vm-41033405 2025-09-16 11:43:01,273 - DEBUG - VM ctest-left_vm-41033405 ID is e57f02df-6326-48fc-90db-4b7852466ba0 2025-09-16 11:43:01,274 - DEBUG - VM ctest-left_vm-41033405 launched on Node cn-jenkins-deploy-platform-ansible-os-4121-1 2025-09-16 11:43:01,353 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/e57f02df-6326-48fc-90db-4b7852466ba0 2025-09-16 11:43:01,360 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/f85a70a1-139f-4f21-83d7-07475aeafa5d 2025-09-16 11:43:02,592 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.85 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.467 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.467/1.656/2.846/1.189 ms') 2025-09-16 11:43:02,592 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-41033405 passed 2025-09-16 11:43:02,742 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:02,742 - DEBUG - Waiting to SSH to VM ctest-left_vm-41033405, IP 213.77.104.131, Port 22 2025-09-16 11:43:02,902 - DEBUG - VM ctest-left_vm-41033405 is ready for SSH connections 2025-09-16 11:43:02,902 - INFO - Waiting for VM ctest-right_vm-28574382 to be up.. 2025-09-16 11:43:02,970 - DEBUG - VM is in ACTIVE state now 2025-09-16 11:43:02,970 - INFO - VM name : ctest-right_vm-28574382 2025-09-16 11:43:03,039 - DEBUG - VM ctest-right_vm-28574382 ID is a65d5947-8ae9-42ba-bce5-0860ce8222d6 2025-09-16 11:43:03,039 - DEBUG - VM ctest-right_vm-28574382 launched on Node cn-jenkins-deploy-platform-ansible-os-4121-1 2025-09-16 11:43:03,110 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/a65d5947-8ae9-42ba-bce5-0860ce8222d6 2025-09-16 11:43:03,131 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/9f703dec-e199-4a9c-a2ef-ecba76f41668 2025-09-16 11:43:04,368 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.66 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.389 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.389/1.526/2.664/1.137 ms') 2025-09-16 11:43:04,368 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-right_vm-28574382 passed 2025-09-16 11:43:04,518 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:04,518 - DEBUG - Waiting to SSH to VM ctest-right_vm-28574382, IP 115.78.195.195, Port 22 2025-09-16 11:43:04,674 - DEBUG - VM ctest-right_vm-28574382 is ready for SSH connections 2025-09-16 11:43:04,679 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-45130465:ctest-si-55605488'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-09-16 11:43:05,102 - INFO - Attaching policy ctest-policy-15725472 to vn ctest-left_vn-83728592 2025-09-16 11:43:05,638 - INFO - Attaching policy ctest-policy-15725472 to vn ctest-right_vn-36685918 2025-09-16 11:43:06,090 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-88379369'] created succesfully 2025-09-16 11:43:06,306 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-45130465', 'ctest-si-55605488'] created succesfully 2025-09-16 11:43:06,306 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:43:06,315 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:43:06,329 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:43:06,404 - DEBUG - Requesting: http://10.0.0.38:8082/service-instance/0c9b3283-2fd9-4a32-8e36-eb7be6a6bbe2 2025-09-16 11:43:06,413 - DEBUG - SI 'ctest-si-55605488' has service template ref to ctest-service_template_1-88379369 2025-09-16 11:43:06,414 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:43:06,419 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:43:06,429 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:43:06,505 - DEBUG - Requesting: http://10.0.0.38:8082/service-instance/0c9b3283-2fd9-4a32-8e36-eb7be6a6bbe2 2025-09-16 11:43:06,515 - DEBUG - Requesting: http://10.0.0.38:8082/port-tuple/6f9a8c53-bb98-45cb-9bce-9b05969c2b10 2025-09-16 11:43:06,525 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/2ac6742a-b653-4131-a44f-a669d3b28664 2025-09-16 11:43:06,535 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/2ae686be-66d4-4843-8f90-f74330fb00e8 2025-09-16 11:43:06,546 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/b7c7a9ee-031f-416d-84e7-7de3b1a4c165 2025-09-16 11:43:06,782 - DEBUG - VM is in ACTIVE state now 2025-09-16 11:43:07,166 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d513a6e8-567a-4a29-9518-c7a87254e34b 2025-09-16 11:43:07,173 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/2ac6742a-b653-4131-a44f-a669d3b28664 2025-09-16 11:43:07,183 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/2ae686be-66d4-4843-8f90-f74330fb00e8 2025-09-16 11:43:07,192 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/b7c7a9ee-031f-416d-84e7-7de3b1a4c165 2025-09-16 11:43:07,202 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/048bd7b6-6052-4b96-b31f-121c110db634 2025-09-16 11:43:07,208 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/5f6ecf7e-5d59-48d4-b16f-864a8b72ffe3 2025-09-16 11:43:07,215 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/bef3a2a0-0602-46a8-ac03-090fe2df0603 2025-09-16 11:43:07,222 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/3c04a99b-cf4f-4748-9e09-b7cf69ca8f55 2025-09-16 11:43:07,228 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/4a416f53-ebf5-4503-98e8-783b29757013 2025-09-16 11:43:07,235 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/68ea1a92-c097-4107-b996-6428b24cd426 2025-09-16 11:43:07,243 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/05645bc7-fba2-4d90-9ade-91981cc694ce 2025-09-16 11:43:07,249 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/74c8a9b3-7434-4885-8376-d40686ddaa99 2025-09-16 11:43:07,256 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/ca112bcb-4bf4-4dbe-a3dd-23d731d5ba48 2025-09-16 11:43:07,603 - DEBUG - VM is in ACTIVE state now 2025-09-16 11:43:07,603 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d513a6e8-567a-4a29-9518-c7a87254e34b 2025-09-16 11:43:07,610 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/2ac6742a-b653-4131-a44f-a669d3b28664 2025-09-16 11:43:07,618 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/2ae686be-66d4-4843-8f90-f74330fb00e8 2025-09-16 11:43:07,625 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/b7c7a9ee-031f-416d-84e7-7de3b1a4c165 2025-09-16 11:43:08,853 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=1.18 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.621 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.621/0.902/1.183/0.281 ms') 2025-09-16 11:43:08,853 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-89437606 passed 2025-09-16 11:43:08,887 - DEBUG - VM ctest-pt_svm0-89437606 Tap interface: {'index': '6', 'name': 'tap2ac6742a-b6', 'uuid': '2ac6742a-b653-4131-a44f-a669d3b28664', 'vrf_name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592:ctest-left_vn-83728592', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592', 'vm_uuid': 'd513a6e8-567a-4a29-9518-c7a87254e34b', 'vm_name': 'ctest-pt_svm0-89437606', 'ip_addr': '213.77.104.132', 'mac_addr': '02:2a:c6:74:2a:b6', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '41', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-45130465:2ac6742a-b653-4131-a44f-a669d3b28664', 'sg_uuid_list': ['82804310-ba65-437a-83b6-423530235f79'], 'static_route_list': None, 'vm_project_uuid': '86465022-529b-4c1a-9c0f-6d7ff3e142b4', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'b7c7a9ee-031f-416d-84e7-7de3b1a4c165', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-09-16 11:43:08,887 - DEBUG - Agent 10.0.0.38 vrf name: default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592:ctest-left_vn-83728592 2025-09-16 11:43:08,892 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592:ctest-left_vn-83728592', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592', 'table_label': '-1', 'vxlan_id': '12', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.17:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-09-16 11:43:09,049 - DEBUG - VM ctest-pt_svm0-89437606 : Tap interface tap2ac6742a-b6 is set to Active 2025-09-16 11:43:09,049 - DEBUG - Tap interface tap2ac6742a-b6 detail : {'index': '6', 'name': 'tap2ac6742a-b6', 'uuid': '2ac6742a-b653-4131-a44f-a669d3b28664', 'vrf_name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592:ctest-left_vn-83728592', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592', 'vm_uuid': 'd513a6e8-567a-4a29-9518-c7a87254e34b', 'vm_name': 'ctest-pt_svm0-89437606', 'ip_addr': '213.77.104.132', 'mac_addr': '02:2a:c6:74:2a:b6', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '41', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-45130465:2ac6742a-b653-4131-a44f-a669d3b28664', 'sg_uuid_list': ['82804310-ba65-437a-83b6-423530235f79'], 'static_route_list': None, 'vm_project_uuid': '86465022-529b-4c1a-9c0f-6d7ff3e142b4', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'b7c7a9ee-031f-416d-84e7-7de3b1a4c165', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-09-16 11:43:09,242 - DEBUG - Starting Layer 2 verification in Agent 2025-09-16 11:43:09,253 - DEBUG - Layer 2 path is seen for VM MAC 02:2a:c6:74:2a:b6 in agent 10.0.0.38 2025-09-16 11:43:09,253 - DEBUG - Active layer 2 route in agent is present for VMI tap2ac6742a-b6 2025-09-16 11:43:09,254 - DEBUG - L2 label(48) matches bw route table and interface table 2025-09-16 11:43:09,258 - DEBUG - VN default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592 is found in Agent of node 10.0.0.38 2025-09-16 11:43:09,470 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592 is consistent in agent 10.0.0.38 2025-09-16 11:43:09,470 - DEBUG - Route for VM IP ['213.77.104.132'] is consistent in agent 10.0.0.38 2025-09-16 11:43:09,470 - DEBUG - VN default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592 verification for VM ctest-pt_svm0-89437606 in Agent 10.0.0.38 passed 2025-09-16 11:43:09,670 - DEBUG - Starting all layer 2 verification in agent 10.0.0.38 2025-09-16 11:43:09,680 - DEBUG - Route for VM MAC 02:2a:c6:74:2a:b6 is consistent in agent 10.0.0.38 2025-09-16 11:43:09,697 - DEBUG - VM ctest-pt_svm0-89437606 Tap interface: {'index': '5', 'name': 'tap2ae686be-66', 'uuid': '2ae686be-66d4-4843-8f90-f74330fb00e8', 'vrf_name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977:ctest-mgmt_vn-47375977', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977', 'vm_uuid': 'd513a6e8-567a-4a29-9518-c7a87254e34b', 'vm_name': 'ctest-pt_svm0-89437606', 'ip_addr': '112.167.125.195', 'mac_addr': '02:2a:e6:86:be:66', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '40', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-45130465:2ae686be-66d4-4843-8f90-f74330fb00e8', 'sg_uuid_list': ['82804310-ba65-437a-83b6-423530235f79'], 'static_route_list': None, 'vm_project_uuid': '86465022-529b-4c1a-9c0f-6d7ff3e142b4', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-09-16 11:43:09,697 - DEBUG - Agent 10.0.0.38 vrf name: default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977:ctest-mgmt_vn-47375977 2025-09-16 11:43:09,701 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977:ctest-mgmt_vn-47375977', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977', 'table_label': '-1', 'vxlan_id': '11', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.17:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-09-16 11:43:09,903 - DEBUG - VM ctest-pt_svm0-89437606 : Tap interface tap2ae686be-66 is set to Active 2025-09-16 11:43:09,903 - DEBUG - Tap interface tap2ae686be-66 detail : {'index': '5', 'name': 'tap2ae686be-66', 'uuid': '2ae686be-66d4-4843-8f90-f74330fb00e8', 'vrf_name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977:ctest-mgmt_vn-47375977', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977', 'vm_uuid': 'd513a6e8-567a-4a29-9518-c7a87254e34b', 'vm_name': 'ctest-pt_svm0-89437606', 'ip_addr': '112.167.125.195', 'mac_addr': '02:2a:e6:86:be:66', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '40', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-45130465:2ae686be-66d4-4843-8f90-f74330fb00e8', 'sg_uuid_list': ['82804310-ba65-437a-83b6-423530235f79'], 'static_route_list': None, 'vm_project_uuid': '86465022-529b-4c1a-9c0f-6d7ff3e142b4', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-09-16 11:43:10,094 - DEBUG - Starting Layer 2 verification in Agent 2025-09-16 11:43:10,104 - DEBUG - Layer 2 path is seen for VM MAC 02:2a:e6:86:be:66 in agent 10.0.0.38 2025-09-16 11:43:10,104 - DEBUG - Active layer 2 route in agent is present for VMI tap2ae686be-66 2025-09-16 11:43:10,104 - DEBUG - L2 label(43) matches bw route table and interface table 2025-09-16 11:43:10,109 - DEBUG - VN default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977 is found in Agent of node 10.0.0.38 2025-09-16 11:43:10,317 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977 is consistent in agent 10.0.0.38 2025-09-16 11:43:10,317 - DEBUG - Route for VM IP ['112.167.125.195'] is consistent in agent 10.0.0.38 2025-09-16 11:43:10,318 - DEBUG - VN default-domain:ctest-TestSvcRegr-45130465:ctest-mgmt_vn-47375977 verification for VM ctest-pt_svm0-89437606 in Agent 10.0.0.38 passed 2025-09-16 11:43:10,510 - DEBUG - Starting all layer 2 verification in agent 10.0.0.38 2025-09-16 11:43:10,523 - DEBUG - Route for VM MAC 02:2a:e6:86:be:66 is consistent in agent 10.0.0.38 2025-09-16 11:43:10,542 - DEBUG - VM ctest-pt_svm0-89437606 Tap interface: {'index': '7', 'name': 'tapb7c7a9ee-03', 'uuid': 'b7c7a9ee-031f-416d-84e7-7de3b1a4c165', 'vrf_name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918:ctest-right_vn-36685918', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918', 'vm_uuid': 'd513a6e8-567a-4a29-9518-c7a87254e34b', 'vm_name': 'ctest-pt_svm0-89437606', 'ip_addr': '115.78.195.196', 'mac_addr': '02:b7:c7:a9:ee:03', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '42', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-45130465:b7c7a9ee-031f-416d-84e7-7de3b1a4c165', 'sg_uuid_list': ['82804310-ba65-437a-83b6-423530235f79'], 'static_route_list': None, 'vm_project_uuid': '86465022-529b-4c1a-9c0f-6d7ff3e142b4', 'admin_state': 'Enabled', 'flow_key_idx': '28', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '2ac6742a-b653-4131-a44f-a669d3b28664', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-09-16 11:43:10,542 - DEBUG - Agent 10.0.0.38 vrf name: default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918:ctest-right_vn-36685918 2025-09-16 11:43:10,547 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918:ctest-right_vn-36685918', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.17:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-09-16 11:43:10,753 - DEBUG - VM ctest-pt_svm0-89437606 : Tap interface tapb7c7a9ee-03 is set to Active 2025-09-16 11:43:10,754 - DEBUG - Tap interface tapb7c7a9ee-03 detail : {'index': '7', 'name': 'tapb7c7a9ee-03', 'uuid': 'b7c7a9ee-031f-416d-84e7-7de3b1a4c165', 'vrf_name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918:ctest-right_vn-36685918', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918', 'vm_uuid': 'd513a6e8-567a-4a29-9518-c7a87254e34b', 'vm_name': 'ctest-pt_svm0-89437606', 'ip_addr': '115.78.195.196', 'mac_addr': '02:b7:c7:a9:ee:03', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '42', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-45130465:b7c7a9ee-031f-416d-84e7-7de3b1a4c165', 'sg_uuid_list': ['82804310-ba65-437a-83b6-423530235f79'], 'static_route_list': None, 'vm_project_uuid': '86465022-529b-4c1a-9c0f-6d7ff3e142b4', 'admin_state': 'Enabled', 'flow_key_idx': '28', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '2ac6742a-b653-4131-a44f-a669d3b28664', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-09-16 11:43:10,946 - DEBUG - Starting Layer 2 verification in Agent 2025-09-16 11:43:10,956 - DEBUG - Layer 2 path is seen for VM MAC 02:b7:c7:a9:ee:03 in agent 10.0.0.38 2025-09-16 11:43:10,956 - DEBUG - Active layer 2 route in agent is present for VMI tapb7c7a9ee-03 2025-09-16 11:43:10,956 - DEBUG - L2 label(53) matches bw route table and interface table 2025-09-16 11:43:10,961 - DEBUG - VN default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918 is found in Agent of node 10.0.0.38 2025-09-16 11:43:11,174 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918 is consistent in agent 10.0.0.38 2025-09-16 11:43:11,174 - DEBUG - Route for VM IP ['115.78.195.196'] is consistent in agent 10.0.0.38 2025-09-16 11:43:11,174 - DEBUG - VN default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918 verification for VM ctest-pt_svm0-89437606 in Agent 10.0.0.38 passed 2025-09-16 11:43:11,366 - DEBUG - Starting all layer 2 verification in agent 10.0.0.38 2025-09-16 11:43:11,377 - DEBUG - Route for VM MAC 02:b7:c7:a9:ee:03 is consistent in agent 10.0.0.38 2025-09-16 11:43:11,377 - INFO - VM ctest-pt_svm0-89437606 verifications in Compute nodes passed 2025-09-16 11:43:11,377 - DEBUG - The SVMs in the SI are : [] 2025-09-16 11:43:11,377 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d513a6e8-567a-4a29-9518-c7a87254e34b 2025-09-16 11:43:11,386 - DEBUG - Service VM for SI 'ctest-si-55605488' is launched 2025-09-16 11:43:11,386 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:43:11,392 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:43:11,439 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:43:11,511 - DEBUG - Requesting: http://10.0.0.38:8082/service-instance/0c9b3283-2fd9-4a32-8e36-eb7be6a6bbe2 2025-09-16 11:43:11,520 - DEBUG - SI ctest-si-55605488 has Port Tuple: ['ctest-port_tuple-78344324'] 2025-09-16 11:43:11,622 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-45130465:ctest-left_vn-83728592 2025-09-16 11:43:11,766 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-45130465:ctest-right_vn-36685918 2025-09-16 11:43:11,920 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:11,927 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:11,927 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:11,932 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:11,932 - INFO - Route to 115.78.195.195 seen in VRF:5 on cn-jenkins-deploy-platform-ansible-os-4121-1, and SI ctest-si-55605488 is seen as the NH 2025-09-16 11:43:12,083 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:12,090 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:12,090 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:12,097 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:12,097 - INFO - Route to 213.77.104.131 seen in VRF:6 on cn-jenkins-deploy-platform-ansible-os-4121-1, and SI ctest-si-55605488 is seen as the NH 2025-09-16 11:43:12,097 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:12,097 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:12,097 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 115.78.195.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-09-16 11:43:12,097 - DEBUG - ping -s 56 -c 3 -W 1 115.78.195.195 2025-09-16 11:43:17,057 - DEBUG - PING 115.78.195.195 (115.78.195.195): 56 data bytes --- 115.78.195.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-09-16 11:43:17,057 - WARNING - Ping to IP 115.78.195.195 from VM ctest-left_vm-41033405 failed 2025-09-16 11:43:18,058 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 115.78.195.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-09-16 11:43:18,058 - DEBUG - ping -s 56 -c 3 -W 1 115.78.195.195 2025-09-16 11:43:21,263 - DEBUG - PING 115.78.195.195 (115.78.195.195): 56 data bytes --- 115.78.195.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-09-16 11:43:21,263 - WARNING - Ping to IP 115.78.195.195 from VM ctest-left_vm-41033405 failed 2025-09-16 11:43:22,264 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 115.78.195.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-09-16 11:43:22,264 - DEBUG - ping -s 56 -c 3 -W 1 115.78.195.195 2025-09-16 11:43:25,468 - DEBUG - PING 115.78.195.195 (115.78.195.195): 56 data bytes --- 115.78.195.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-09-16 11:43:25,469 - WARNING - Ping to IP 115.78.195.195 from VM ctest-left_vm-41033405 failed 2025-09-16 11:43:26,469 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 115.78.195.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-09-16 11:43:26,470 - DEBUG - ping -s 56 -c 3 -W 1 115.78.195.195 2025-09-16 11:43:29,676 - DEBUG - PING 115.78.195.195 (115.78.195.195): 56 data bytes --- 115.78.195.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-09-16 11:43:29,677 - WARNING - Ping to IP 115.78.195.195 from VM ctest-left_vm-41033405 failed 2025-09-16 11:43:30,678 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 115.78.195.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-09-16 11:43:30,678 - DEBUG - ping -s 56 -c 3 -W 1 115.78.195.195 2025-09-16 11:43:33,889 - DEBUG - PING 115.78.195.195 (115.78.195.195): 56 data bytes --- 115.78.195.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-09-16 11:43:33,889 - WARNING - Ping to IP 115.78.195.195 from VM ctest-left_vm-41033405 failed 2025-09-16 11:43:34,890 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 115.78.195.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-09-16 11:43:34,890 - DEBUG - ping -s 56 -c 3 -W 1 115.78.195.195 2025-09-16 11:43:38,092 - DEBUG - PING 115.78.195.195 (115.78.195.195): 56 data bytes --- 115.78.195.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-09-16 11:43:38,093 - WARNING - Ping to IP 115.78.195.195 from VM ctest-left_vm-41033405 failed 2025-09-16 11:43:39,093 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 115.78.195.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-09-16 11:43:39,094 - DEBUG - ping -s 56 -c 3 -W 1 115.78.195.195 2025-09-16 11:43:42,310 - DEBUG - PING 115.78.195.195 (115.78.195.195): 56 data bytes --- 115.78.195.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-09-16 11:43:42,311 - WARNING - Ping to IP 115.78.195.195 from VM ctest-left_vm-41033405 failed 2025-09-16 11:43:43,312 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 115.78.195.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-09-16 11:43:43,312 - DEBUG - ping -s 56 -c 3 -W 1 115.78.195.195 2025-09-16 11:43:46,523 - DEBUG - PING 115.78.195.195 (115.78.195.195): 56 data bytes --- 115.78.195.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-09-16 11:43:46,523 - WARNING - Ping to IP 115.78.195.195 from VM ctest-left_vm-41033405 failed 2025-09-16 11:43:47,525 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 115.78.195.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-09-16 11:43:47,525 - DEBUG - ping -s 56 -c 3 -W 1 115.78.195.195 2025-09-16 11:43:50,746 - DEBUG - PING 115.78.195.195 (115.78.195.195): 56 data bytes --- 115.78.195.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-09-16 11:43:50,746 - WARNING - Ping to IP 115.78.195.195 from VM ctest-left_vm-41033405 failed 2025-09-16 11:43:51,747 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 115.78.195.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-09-16 11:43:51,747 - DEBUG - ping -s 56 -c 3 -W 1 115.78.195.195 2025-09-16 11:43:54,946 - DEBUG - PING 115.78.195.195 (115.78.195.195): 56 data bytes --- 115.78.195.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-09-16 11:43:54,946 - WARNING - Ping to IP 115.78.195.195 from VM ctest-left_vm-41033405 failed 2025-09-16 11:43:55,946 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 115.78.195.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-09-16 11:43:55,946 - DEBUG - ping -s 56 -c 3 -W 1 115.78.195.195 2025-09-16 11:43:59,156 - DEBUG - PING 115.78.195.195 (115.78.195.195): 56 data bytes --- 115.78.195.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-09-16 11:43:59,156 - WARNING - Ping to IP 115.78.195.195 from VM ctest-left_vm-41033405 failed 2025-09-16 11:43:59,161 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-16 11:43:59,161 - INFO - Dettaching policy ctest-policy-15725472 from vn ctest-right_vn-36685918 2025-09-16 11:43:59,354 - INFO - Dettaching policy ctest-policy-15725472 from vn ctest-left_vn-83728592 2025-09-16 11:43:59,615 - INFO - Deleted policy ctest-policy-15725472 2025-09-16 11:43:59,615 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-45130465', 'ctest-si-55605488'] 2025-09-16 11:43:59,714 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-45130465', 'ctest-si-55605488'] 2025-09-16 11:43:59,714 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:43:59,722 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:43:59,736 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:43:59,807 - DEBUG - Service instance ctest-si-55605488 removed from api server 2025-09-16 11:43:59,807 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d513a6e8-567a-4a29-9518-c7a87254e34b 2025-09-16 11:43:59,813 - DEBUG - All Service VMs unlinked from SI ctest-si-55605488 2025-09-16 11:43:59,819 - DEBUG - 0 svc intances found in all projects. They are [] 2025-09-16 11:43:59,819 - DEBUG - 0 svc intances found in current project. They are [] 2025-09-16 11:43:59,866 - DEBUG - 0 svc intances found in all projects. They are [] 2025-09-16 11:43:59,866 - DEBUG - 0 svc intances found in current project. They are [] 2025-09-16 11:43:59,866 - INFO - Deleting VM ctest-pt_svm0-89437606 2025-09-16 11:43:59,944 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-88379369'] 2025-09-16 11:44:00,070 - INFO - Service template: ['default-domain', 'ctest-service_template_1-88379369'] deleted successfully. 2025-09-16 11:44:00,070 - INFO - Deleting VM ctest-right_vm-28574382 2025-09-16 11:44:00,172 - INFO - Deleting VM ctest-left_vm-41033405 2025-09-16 11:44:00,262 - INFO - Deleting VN ctest-right_vn-36685918 2025-09-16 11:44:00,298 - DEBUG - VN 6059b199-34eb-42fd-b586-2d7b24aaef82 still in use: Unable to complete operation on network 6059b199-34eb-42fd-b586-2d7b24aaef82. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-169344a3-b679-4a25-836f-debfd75da460'] 2025-09-16 11:44:00,298 - WARNING - Deleting VN ctest-right_vn-36685918 failed..Will retry 2025-09-16 11:44:02,393 - DEBUG - Response for deleting network () 2025-09-16 11:44:02,393 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3c7c21ae-7cfb-40bf-a4e8-170e38ac5094 2025-09-16 11:44:02,401 - DEBUG - Response Code: 404 2025-09-16 11:44:02,401 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:44:02,406 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:44:02,460 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:44:02,539 - INFO - Validated that VN ctest-right_vn-36685918 is not found in API Server 2025-09-16 11:44:02,549 - DEBUG - VN ctest-right_vn-36685918 is not present in Agent 10.0.0.38 2025-09-16 11:44:02,549 - INFO - Validated that VN ctest-right_vn-36685918 is not in any agent 2025-09-16 11:44:02,562 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-36685918 info 2025-09-16 11:44:02,562 - INFO - Deleting VN ctest-left_vn-83728592 2025-09-16 11:44:02,662 - DEBUG - Response for deleting network () 2025-09-16 11:44:02,662 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/79c259ad-f86c-4c59-bb80-e5638b610e7d 2025-09-16 11:44:02,669 - DEBUG - Response Code: 404 2025-09-16 11:44:02,670 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:44:02,675 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:44:02,727 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:44:02,794 - INFO - Validated that VN ctest-left_vn-83728592 is not found in API Server 2025-09-16 11:44:02,803 - DEBUG - VN ctest-left_vn-83728592 is not present in Agent 10.0.0.38 2025-09-16 11:44:02,803 - INFO - Validated that VN ctest-left_vn-83728592 is not in any agent 2025-09-16 11:44:02,815 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-83728592 info 2025-09-16 11:44:02,815 - INFO - Deleting VN ctest-mgmt_vn-47375977 2025-09-16 11:44:02,900 - DEBUG - Response for deleting network () 2025-09-16 11:44:02,900 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3cc163e7-b82e-433c-814c-8c1cdb222289 2025-09-16 11:44:02,906 - DEBUG - Response Code: 404 2025-09-16 11:44:02,906 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-16 11:44:02,911 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d8e99ed6-e77a-4092-9c7e-98035934e7ea 2025-09-16 11:44:02,967 - DEBUG - Requesting: http://10.0.0.38:8082/project/86465022-529b-4c1a-9c0f-6d7ff3e142b4 2025-09-16 11:44:03,034 - INFO - Validated that VN ctest-mgmt_vn-47375977 is not found in API Server 2025-09-16 11:44:03,044 - DEBUG - VN ctest-mgmt_vn-47375977 is not present in Agent 10.0.0.38 2025-09-16 11:44:03,044 - INFO - Validated that VN ctest-mgmt_vn-47375977 is not in any agent 2025-09-16 11:44:03,057 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-47375977 info 2025-09-16 11:44:03,306 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Tue Sep 16 11:43:59 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/svc_firewall/test_svc_fw.py in test_svc_in_network_datapath(self=) 23 @preposttest_wrapper 24 def test_svc_in_network_datapath(self): 25 return self.verify_svc_chain(svc_img_name='cirros_in_net', service_mode='in-network', 26 create_svms=True) 27 self = self.verify_svc_chain = > svc_img_name undefined service_mode undefined create_svms undefined /contrail-test/common/servicechain/verify.py in verify_svc_chain(self=, *args=(), **kwargs={'create_svms': True, 'service_mode': 'in-network', 'svc_img_name': 'cirros_in_net'}) 368 # Ping from left VM to right VM 369 errmsg = "Ping to Right VM %s from Left VM failed" % right_vm_fixture.vm_ip 370 assert left_vm_fixture.ping_with_certainty( 371 right_vm_fixture.vm_ip, count='3'), errmsg 372 return ret_dict left_vm_fixture = left_vm_fixture.ping_with_certainty = .deco_retry..f_retry of > right_vm_fixture = right_vm_fixture.vm_ip = '115.78.195.195' count undefined errmsg = 'Ping to Right VM 115.78.195.195 from Left VM failed' AssertionError: Ping to Right VM 115.78.195.195 from Left VM failed __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('Ping to Right VM 115.78.195.195 from Left VM failed',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/svc_firewall/test_svc_fw.py", line 25, in test_svc_in_network_datapath return self.verify_svc_chain(svc_img_name='cirros_in_net', service_mode='in-network', File "/contrail-test/common/servicechain/verify.py", line 370, in verify_svc_chain assert left_vm_fixture.ping_with_certainty( AssertionError: Ping to Right VM 115.78.195.195 from Left VM failed 2025-09-16 11:44:03,311 - DEBUG - No XMPP flaps were noticed during the test 2025-09-16 11:44:03,311 - INFO -
2025-09-16 11:44:03,312 - INFO - END TEST : test_svc_in_network_datapath : FAILED[0:01:55]
2025-09-16 11:44:03,312 - INFO - -------------------------------------------------------------------------------- 2025-09-16 11:44:03,984 - INFO - Deleted project: ctest-TestSvcRegr-45130465, ID : 86465022-529b-4c1a-9c0f-6d7ff3e142b4