2025-03-13 02:21:15,419 - INFO - Domain Default found not creating 2025-03-13 02:21:15,589 - INFO - Project ctest-TestSvcRegr-25656382 not found, creating it 2025-03-13 02:21:16,289 - INFO - Created Project:ctest-TestSvcRegr-25656382, ID : 45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:21:17,794 - INFO - ================================================================================ 2025-03-13 02:21:17,794 - INFO - STARTING TEST : test_svc_in_network_datapath 2025-03-13 02:21:19,101 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.20': '0', '10.20.0.28': '0'}, '10.0.0.23': {'10.20.0.6': '0', '10.20.0.20': '0'}} with 2025-03-13 02:21:19,102 - INFO - Initial checks done. Running the testcase now 2025-03-13 02:21:19,102 - INFO - 2025-03-13 02:21:19,878 - DEBUG - Response for create_network : {'network': {'id': '2fd6d6a0-9963-42c5-8017-4c67cf74c48a', 'name': 'ctest-mgmt_vn-78492785', 'tenant_id': '45c29f1da2784742811153394f79f8bb', 'project_id': '45c29f1da2784742811153394f79f8bb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-25656382', 'ctest-mgmt_vn-78492785'], 'port_security_enabled': True, 'description': ''}} 2025-03-13 02:21:20,206 - DEBUG - Response for create_subnet : {'subnet': {'id': '1d5e94e1-3466-4ce8-a3d9-fe3d0abd7b05', 'name': '', 'tenant_id': '45c29f1da2784742811153394f79f8bb', 'network_id': '2fd6d6a0-9963-42c5-8017-4c67cf74c48a', 'ip_version': 4, 'cidr': '221.220.47.64/26', 'allocation_pools': [{'start': '221.220.47.66', 'end': '221.220.47.126'}], 'gateway_ip': '221.220.47.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '221.220.47.66', 'tags': [], 'project_id': '45c29f1da2784742811153394f79f8bb'}} 2025-03-13 02:21:20,235 - INFO - Created VN ctest-mgmt_vn-78492785 2025-03-13 02:21:20,251 - DEBUG - VN ctest-mgmt_vn-78492785 UUID is 2fd6d6a0-9963-42c5-8017-4c67cf74c48a 2025-03-13 02:21:20,340 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:21:20,638 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:21:20,678 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:21:20,699 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:21:20,824 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/2fd6d6a0-9963-42c5-8017-4c67cf74c48a 2025-03-13 02:21:20,842 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/2fd6d6a0-9963-42c5-8017-4c67cf74c48a 2025-03-13 02:21:20,860 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/5853cc06-b3a2-4a44-bf4f-402035429747 2025-03-13 02:21:20,877 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/5853cc06-b3a2-4a44-bf4f-402035429747 2025-03-13 02:21:20,889 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/259c74bf-f247-494e-a187-59226cadacb1 2025-03-13 02:21:20,899 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-03-13 02:21:20,900 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/2fd6d6a0-9963-42c5-8017-4c67cf74c48a 2025-03-13 02:21:20,913 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/5853cc06-b3a2-4a44-bf4f-402035429747 2025-03-13 02:21:20,940 - INFO - Verified VN network id 8 for VN 2fd6d6a0-9963-42c5-8017-4c67cf74c48a 2025-03-13 02:21:20,940 - INFO - Verifications in API Server for VN ctest-mgmt_vn-78492785 passed 2025-03-13 02:21:20,940 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/2fd6d6a0-9963-42c5-8017-4c67cf74c48a 2025-03-13 02:21:20,954 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/5853cc06-b3a2-4a44-bf4f-402035429747 2025-03-13 02:21:20,966 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/5853cc06-b3a2-4a44-bf4f-402035429747 2025-03-13 02:21:20,976 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/259c74bf-f247-494e-a187-59226cadacb1 2025-03-13 02:21:20,993 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-25656382', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3447178550055224005', 'uuid-lslong': '9229929970064999562'}, 'enable': 'true', 'created': '2025-03-13T02:21:19', 'last-modified': '2025-03-13T02:21:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.871012'} 2025-03-13 02:21:21,000 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-03-13 02:21:21,007 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-25656382', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3447178550055224005', 'uuid-lslong': '9229929970064999562'}, 'enable': 'true', 'created': '2025-03-13T02:21:19', 'last-modified': '2025-03-13T02:21:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.886335'} 2025-03-13 02:21:21,017 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-03-13 02:21:21,025 - DEBUG - Control-node 10.0.0.36 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-25656382', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3447178550055224005', 'uuid-lslong': '9229929970064999562'}, 'enable': 'true', 'created': '2025-03-13T02:21:19', 'last-modified': '2025-03-13T02:21:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.915106'} 2025-03-13 02:21:21,033 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-03-13 02:21:21,033 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-78492785 passed 2025-03-13 02:21:21,034 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-78492785 in API_Server ====== 2025-03-13 02:21:21,034 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:21:21,042 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:21:21,061 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:21:21,174 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/2fd6d6a0-9963-42c5-8017-4c67cf74c48a 2025-03-13 02:21:21,194 - DEBUG - =>VN ctest-mgmt_vn-78492785 has no policy to be verified 2025-03-13 02:21:21,194 - DEBUG - Verifying the vn in opserver 2025-03-13 02:21:21,195 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785 virtual network link through opserver 10.0.0.22 2025-03-13 02:21:21,195 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-03-13 02:21:21,495 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-03-13 02:21:21,560 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785?flat'} 2025-03-13 02:21:21,560 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785 virtual network link through opserver 10.0.0.27 2025-03-13 02:21:21,560 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-03-13 02:21:21,859 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-03-13 02:21:21,924 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785?flat'} 2025-03-13 02:21:21,924 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785 virtual network link through opserver 10.0.0.36 2025-03-13 02:21:21,924 - DEBUG - Requesting: http://10.0.0.36:8081/analytics/uves/virtual-networks 2025-03-13 02:21:22,221 - DEBUG - Requesting: http://10.0.0.36:8081/analytics/uves/virtual-networks 2025-03-13 02:21:22,286 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785', 'href': 'http://10.0.0.36:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785?flat'} 2025-03-13 02:21:22,286 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785 is found in opserver 2025-03-13 02:21:22,315 - DEBUG - Do not have enough data to verify VN in agent 2025-03-13 02:21:22,329 - DEBUG - VRF ids for VN ctest-mgmt_vn-78492785: {} 2025-03-13 02:21:22,741 - DEBUG - Response for create_network : {'network': {'id': 'e5589ad0-06ae-4b94-bfb1-10c718bc88f5', 'name': 'ctest-left_vn-47852462', 'tenant_id': '45c29f1da2784742811153394f79f8bb', 'project_id': '45c29f1da2784742811153394f79f8bb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-25656382', 'ctest-left_vn-47852462'], 'port_security_enabled': True, 'description': ''}} 2025-03-13 02:21:23,050 - DEBUG - Response for create_subnet : {'subnet': {'id': '68bc3125-8d76-4584-a9ed-7505f17e5069', 'name': '', 'tenant_id': '45c29f1da2784742811153394f79f8bb', 'network_id': 'e5589ad0-06ae-4b94-bfb1-10c718bc88f5', 'ip_version': 4, 'cidr': '34.191.15.64/26', 'allocation_pools': [{'start': '34.191.15.66', 'end': '34.191.15.126'}], 'gateway_ip': '34.191.15.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '34.191.15.66', 'tags': [], 'project_id': '45c29f1da2784742811153394f79f8bb'}} 2025-03-13 02:21:23,079 - INFO - Created VN ctest-left_vn-47852462 2025-03-13 02:21:23,099 - DEBUG - VN ctest-left_vn-47852462 UUID is e5589ad0-06ae-4b94-bfb1-10c718bc88f5 2025-03-13 02:21:23,190 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:21:23,199 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:21:23,216 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:21:23,325 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/e5589ad0-06ae-4b94-bfb1-10c718bc88f5 2025-03-13 02:21:23,343 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/e5589ad0-06ae-4b94-bfb1-10c718bc88f5 2025-03-13 02:21:23,359 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/90603425-8633-4fc4-9606-d0d1c7f30b5e 2025-03-13 02:21:23,368 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/90603425-8633-4fc4-9606-d0d1c7f30b5e 2025-03-13 02:21:23,378 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/fd6b42d9-21a7-4883-9457-3290e1b8829c 2025-03-13 02:21:23,388 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-03-13 02:21:23,388 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/e5589ad0-06ae-4b94-bfb1-10c718bc88f5 2025-03-13 02:21:23,401 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/90603425-8633-4fc4-9606-d0d1c7f30b5e 2025-03-13 02:21:23,422 - INFO - Verified VN network id 9 for VN e5589ad0-06ae-4b94-bfb1-10c718bc88f5 2025-03-13 02:21:23,422 - INFO - Verifications in API Server for VN ctest-left_vn-47852462 passed 2025-03-13 02:21:23,422 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/e5589ad0-06ae-4b94-bfb1-10c718bc88f5 2025-03-13 02:21:23,437 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/90603425-8633-4fc4-9606-d0d1c7f30b5e 2025-03-13 02:21:23,450 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/90603425-8633-4fc4-9606-d0d1c7f30b5e 2025-03-13 02:21:23,459 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/fd6b42d9-21a7-4883-9457-3290e1b8829c 2025-03-13 02:21:23,474 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-25656382', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16526129050891996052', 'uuid-lslong': '13812839979421567221'}, 'enable': 'true', 'created': '2025-03-13T02:21:22', 'last-modified': '2025-03-13T02:21:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.511966'} 2025-03-13 02:21:23,483 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-03-13 02:21:23,490 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-25656382', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16526129050891996052', 'uuid-lslong': '13812839979421567221'}, 'enable': 'true', 'created': '2025-03-13T02:21:22', 'last-modified': '2025-03-13T02:21:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.514102'} 2025-03-13 02:21:23,499 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-03-13 02:21:23,509 - DEBUG - Control-node 10.0.0.36 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-25656382', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16526129050891996052', 'uuid-lslong': '13812839979421567221'}, 'enable': 'true', 'created': '2025-03-13T02:21:22', 'last-modified': '2025-03-13T02:21:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.525248'} 2025-03-13 02:21:23,521 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-03-13 02:21:23,521 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-47852462 passed 2025-03-13 02:21:23,521 - DEBUG - ====Verifying policy data for ctest-left_vn-47852462 in API_Server ====== 2025-03-13 02:21:23,521 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:21:23,530 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:21:23,544 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:21:23,661 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/e5589ad0-06ae-4b94-bfb1-10c718bc88f5 2025-03-13 02:21:23,673 - DEBUG - =>VN ctest-left_vn-47852462 has no policy to be verified 2025-03-13 02:21:23,673 - DEBUG - Verifying the vn in opserver 2025-03-13 02:21:23,673 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462 virtual network link through opserver 10.0.0.22 2025-03-13 02:21:23,673 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-03-13 02:21:23,741 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462?flat'} 2025-03-13 02:21:23,743 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462 virtual network link through opserver 10.0.0.27 2025-03-13 02:21:23,743 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-03-13 02:21:23,812 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462?flat'} 2025-03-13 02:21:23,812 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462 virtual network link through opserver 10.0.0.36 2025-03-13 02:21:23,812 - DEBUG - Requesting: http://10.0.0.36:8081/analytics/uves/virtual-networks 2025-03-13 02:21:23,879 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462', 'href': 'http://10.0.0.36:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462?flat'} 2025-03-13 02:21:23,879 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462 is found in opserver 2025-03-13 02:21:23,909 - DEBUG - Do not have enough data to verify VN in agent 2025-03-13 02:21:23,924 - DEBUG - VRF ids for VN ctest-left_vn-47852462: {} 2025-03-13 02:21:24,303 - DEBUG - Response for create_network : {'network': {'id': '1474c8f3-388a-401b-a913-54d63e07e3b5', 'name': 'ctest-right_vn-74032636', 'tenant_id': '45c29f1da2784742811153394f79f8bb', 'project_id': '45c29f1da2784742811153394f79f8bb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-25656382', 'ctest-right_vn-74032636'], 'port_security_enabled': True, 'description': ''}} 2025-03-13 02:21:24,667 - DEBUG - Response for create_subnet : {'subnet': {'id': '5ae569e3-c6c2-4f79-886f-ac2e1c204b90', 'name': '', 'tenant_id': '45c29f1da2784742811153394f79f8bb', 'network_id': '1474c8f3-388a-401b-a913-54d63e07e3b5', 'ip_version': 4, 'cidr': '213.50.42.192/26', 'allocation_pools': [{'start': '213.50.42.194', 'end': '213.50.42.254'}], 'gateway_ip': '213.50.42.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '213.50.42.194', 'tags': [], 'project_id': '45c29f1da2784742811153394f79f8bb'}} 2025-03-13 02:21:24,709 - INFO - Created VN ctest-right_vn-74032636 2025-03-13 02:21:24,730 - DEBUG - VN ctest-right_vn-74032636 UUID is 1474c8f3-388a-401b-a913-54d63e07e3b5 2025-03-13 02:21:24,921 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:21:24,929 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:21:24,942 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:21:25,067 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1474c8f3-388a-401b-a913-54d63e07e3b5 2025-03-13 02:21:25,088 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1474c8f3-388a-401b-a913-54d63e07e3b5 2025-03-13 02:21:25,104 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/9fa89df0-409b-406c-baa9-1d5f3fe9099d 2025-03-13 02:21:25,118 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/9fa89df0-409b-406c-baa9-1d5f3fe9099d 2025-03-13 02:21:25,129 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/59c0fdff-0d9f-4cda-b7dc-097f6e6a328b 2025-03-13 02:21:25,138 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-03-13 02:21:25,138 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1474c8f3-388a-401b-a913-54d63e07e3b5 2025-03-13 02:21:25,152 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/9fa89df0-409b-406c-baa9-1d5f3fe9099d 2025-03-13 02:21:25,176 - INFO - Verified VN network id 10 for VN 1474c8f3-388a-401b-a913-54d63e07e3b5 2025-03-13 02:21:25,176 - INFO - Verifications in API Server for VN ctest-right_vn-74032636 passed 2025-03-13 02:21:25,176 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1474c8f3-388a-401b-a913-54d63e07e3b5 2025-03-13 02:21:25,190 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/9fa89df0-409b-406c-baa9-1d5f3fe9099d 2025-03-13 02:21:25,201 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/9fa89df0-409b-406c-baa9-1d5f3fe9099d 2025-03-13 02:21:25,211 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/59c0fdff-0d9f-4cda-b7dc-097f6e6a328b 2025-03-13 02:21:25,228 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-25656382', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1474023925008187419', 'uuid-lslong': '12183174696107762613'}, 'enable': 'true', 'created': '2025-03-13T02:21:24', 'last-modified': '2025-03-13T02:21:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.650871'} 2025-03-13 02:21:25,236 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-03-13 02:21:25,244 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-25656382', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1474023925008187419', 'uuid-lslong': '12183174696107762613'}, 'enable': 'true', 'created': '2025-03-13T02:21:24', 'last-modified': '2025-03-13T02:21:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.669309'} 2025-03-13 02:21:25,252 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-03-13 02:21:25,261 - DEBUG - Control-node 10.0.0.36 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-25656382', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1474023925008187419', 'uuid-lslong': '12183174696107762613'}, 'enable': 'true', 'created': '2025-03-13T02:21:24', 'last-modified': '2025-03-13T02:21:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.698456'} 2025-03-13 02:21:25,270 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-03-13 02:21:25,270 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-74032636 passed 2025-03-13 02:21:25,271 - DEBUG - ====Verifying policy data for ctest-right_vn-74032636 in API_Server ====== 2025-03-13 02:21:25,271 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:21:25,279 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:21:25,295 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:21:25,408 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1474c8f3-388a-401b-a913-54d63e07e3b5 2025-03-13 02:21:25,426 - DEBUG - =>VN ctest-right_vn-74032636 has no policy to be verified 2025-03-13 02:21:25,426 - DEBUG - Verifying the vn in opserver 2025-03-13 02:21:25,426 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636 virtual network link through opserver 10.0.0.22 2025-03-13 02:21:25,426 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-03-13 02:21:25,502 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636?flat'} 2025-03-13 02:21:25,502 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636 virtual network link through opserver 10.0.0.27 2025-03-13 02:21:25,502 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-03-13 02:21:25,572 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636?flat'} 2025-03-13 02:21:25,572 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636 virtual network link through opserver 10.0.0.36 2025-03-13 02:21:25,572 - DEBUG - Requesting: http://10.0.0.36:8081/analytics/uves/virtual-networks 2025-03-13 02:21:25,643 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636', 'href': 'http://10.0.0.36:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636?flat'} 2025-03-13 02:21:25,643 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636 is found in opserver 2025-03-13 02:21:25,674 - DEBUG - Do not have enough data to verify VN in agent 2025-03-13 02:21:25,695 - DEBUG - VRF ids for VN ctest-right_vn-74032636: {} 2025-03-13 02:21:25,763 - DEBUG - Services list from nova: [, , , ] 2025-03-13 02:21:26,960 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-2857-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-2857-1) 2025-03-13 02:21:28,669 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-2857-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-2857-2) 2025-03-13 02:21:28,669 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-10866697'] 2025-03-13 02:21:29,043 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-10866697'] created succesfully 2025-03-13 02:21:29,555 - DEBUG - Image by name cirros_in_net not found 2025-03-13 02:21:29,556 - DEBUG - Installing image cirros_in_net 2025-03-13 02:21:29,556 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-03-13 02:21:29,556 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-03-13 02:21:29,556 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-03-13 02:21:29,583 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2025-03-13 02:21:29,934 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2025-03-13 02:21:29,934 - DEBUG - Unzip image 2025-03-13 02:21:29,934 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2025-03-13 02:21:30,112 - DEBUG - Try to create image in user context 2025-03-13 02:21:30,410 - DEBUG - Image has been created in user context 2025-03-13 02:21:30,410 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2025-03-13 02:21:30,424 - DEBUG - Downloaded image has been removed 2025-03-13 02:21:30,441 - DEBUG - Uploaded image status = active 2025-03-13 02:21:31,857 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-2857-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-2857-1) 2025-03-13 02:21:31,857 - INFO - Waiting for VM ctest-pt_svm0-96930215 to be up.. 2025-03-13 02:21:31,921 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-03-13 02:21:37,044 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-03-13 02:21:42,150 - DEBUG - VM is in ACTIVE state now 2025-03-13 02:21:42,151 - INFO - VM name : ctest-pt_svm0-96930215 2025-03-13 02:21:42,280 - DEBUG - VM ctest-pt_svm0-96930215 ID is a96a7874-e1fa-444e-ba39-e2daaff3392b 2025-03-13 02:21:42,315 - DEBUG - VM ctest-pt_svm0-96930215 launched on Node an-jenkins-deploy-platform-ansible-os-2857-1 2025-03-13 02:21:42,635 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine/a96a7874-e1fa-444e-ba39-e2daaff3392b 2025-03-13 02:21:42,943 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine/a96a7874-e1fa-444e-ba39-e2daaff3392b 2025-03-13 02:21:42,981 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine-interface/2ae1d29b-8046-49e6-b21a-37ce8cc3d656 2025-03-13 02:21:42,998 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine-interface/4e9e3a30-cebf-4033-95c5-4c802800248c 2025-03-13 02:21:43,014 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine-interface/99af1a1a-cdb0-4a8f-9211-49d43dc0072b 2025-03-13 02:21:46,326 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-03-13 02:21:46,326 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-96930215 failed! 2025-03-13 02:21:46,346 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785 is 221.220.47.65 and allocation pool is NOT set 2025-03-13 02:21:50,421 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-03-13 02:21:50,421 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-96930215 failed! 2025-03-13 02:21:50,441 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785 is 221.220.47.65 and allocation pool is NOT set 2025-03-13 02:21:54,518 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-03-13 02:21:54,518 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-96930215 failed! 2025-03-13 02:21:54,538 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785 is 221.220.47.65 and allocation pool is NOT set 2025-03-13 02:21:58,613 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=6.62 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1017ms\r\nrtt min/avg/max/mdev = 6.623/6.623/6.623/0.000 ms') 2025-03-13 02:21:58,613 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-96930215 passed 2025-03-13 02:21:58,735 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:21:58,735 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96930215, IP 221.220.47.67, Port 22 2025-03-13 02:21:58,805 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-03-13 02:21:58,939 - DEBUG - VM ctest-pt_svm0-96930215 is NOT ready for SSH connections, VM status: ACTIVE 2025-03-13 02:22:03,940 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:03,940 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96930215, IP 221.220.47.67, Port 22 2025-03-13 02:22:03,999 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-03-13 02:22:04,141 - DEBUG - VM ctest-pt_svm0-96930215 is NOT ready for SSH connections, VM status: ACTIVE 2025-03-13 02:22:09,142 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:09,142 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96930215, IP 221.220.47.67, Port 22 2025-03-13 02:22:09,209 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-03-13 02:22:09,316 - DEBUG - VM ctest-pt_svm0-96930215 is NOT ready for SSH connections, VM status: ACTIVE 2025-03-13 02:22:14,318 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:14,318 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96930215, IP 221.220.47.67, Port 22 2025-03-13 02:22:14,385 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-03-13 02:22:14,505 - DEBUG - VM ctest-pt_svm0-96930215 is NOT ready for SSH connections, VM status: ACTIVE 2025-03-13 02:22:19,506 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:19,506 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96930215, IP 221.220.47.67, Port 22 2025-03-13 02:22:19,674 - DEBUG - VM ctest-pt_svm0-96930215 is ready for SSH connections 2025-03-13 02:22:19,799 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:19,799 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96930215, IP 221.220.47.67, Port 22 2025-03-13 02:22:19,971 - DEBUG - VM ctest-pt_svm0-96930215 is ready for SSH connections 2025-03-13 02:22:20,100 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:20,100 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96930215, IP 221.220.47.67, Port 22 2025-03-13 02:22:20,268 - DEBUG - VM ctest-pt_svm0-96930215 is ready for SSH connections 2025-03-13 02:22:20,278 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-25656382', 'ctest-si-17221843'] 2025-03-13 02:22:21,262 - INFO - Waiting for VM ctest-left_vm-81039376 to be up.. 2025-03-13 02:22:21,459 - DEBUG - VM is in ACTIVE state now 2025-03-13 02:22:21,459 - INFO - VM name : ctest-left_vm-81039376 2025-03-13 02:22:21,708 - DEBUG - VM ctest-left_vm-81039376 ID is 9afa28b0-bb30-4237-809d-bd3675a2c22f 2025-03-13 02:22:21,708 - DEBUG - VM ctest-left_vm-81039376 launched on Node an-jenkins-deploy-platform-ansible-os-2857-1 2025-03-13 02:22:21,895 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine/9afa28b0-bb30-4237-809d-bd3675a2c22f 2025-03-13 02:22:21,929 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine-interface/9361bd31-47f8-49ce-adbf-70a5cdd45f41 2025-03-13 02:22:23,195 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.90 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.437 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.437/1.667/2.897/1.230 ms') 2025-03-13 02:22:23,195 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-81039376 passed 2025-03-13 02:22:23,323 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:23,323 - DEBUG - Waiting to SSH to VM ctest-left_vm-81039376, IP 34.191.15.67, Port 22 2025-03-13 02:22:23,483 - DEBUG - VM ctest-left_vm-81039376 is ready for SSH connections 2025-03-13 02:22:23,483 - INFO - Waiting for VM ctest-right_vm-46737236 to be up.. 2025-03-13 02:22:23,592 - DEBUG - VM is in ACTIVE state now 2025-03-13 02:22:23,592 - INFO - VM name : ctest-right_vm-46737236 2025-03-13 02:22:23,686 - DEBUG - VM ctest-right_vm-46737236 ID is 2f243805-14b1-49de-a32f-7436cbabbcf4 2025-03-13 02:22:23,687 - DEBUG - VM ctest-right_vm-46737236 launched on Node an-jenkins-deploy-platform-ansible-os-2857-2 2025-03-13 02:22:23,786 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine/2f243805-14b1-49de-a32f-7436cbabbcf4 2025-03-13 02:22:23,800 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine-interface/3d1616fd-368f-47b1-8607-e454e8ab232c 2025-03-13 02:22:25,026 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.72 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.576 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.576/2.149/3.723/1.573 ms') 2025-03-13 02:22:25,026 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-right_vm-46737236 passed 2025-03-13 02:22:25,152 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:25,152 - DEBUG - Waiting to SSH to VM ctest-right_vm-46737236, IP 213.50.42.195, Port 22 2025-03-13 02:22:25,329 - DEBUG - VM ctest-right_vm-46737236 is ready for SSH connections 2025-03-13 02:22:25,340 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-25656382:ctest-si-17221843'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-03-13 02:22:25,734 - INFO - Attaching policy ctest-policy-59482655 to vn ctest-left_vn-47852462 2025-03-13 02:22:26,196 - INFO - Attaching policy ctest-policy-59482655 to vn ctest-right_vn-74032636 2025-03-13 02:22:26,567 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-10866697'] created succesfully 2025-03-13 02:22:26,878 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-25656382', 'ctest-si-17221843'] created succesfully 2025-03-13 02:22:26,879 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:22:26,887 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:22:26,905 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:22:27,030 - DEBUG - Requesting: http://10.0.0.22:8082/service-instance/0b4ba8b0-4d5f-4fc9-9c10-cd908ea98a79 2025-03-13 02:22:27,045 - DEBUG - SI 'ctest-si-17221843' has service template ref to ctest-service_template_1-10866697 2025-03-13 02:22:27,045 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:22:27,057 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:22:27,077 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:22:27,205 - DEBUG - Requesting: http://10.0.0.22:8082/service-instance/0b4ba8b0-4d5f-4fc9-9c10-cd908ea98a79 2025-03-13 02:22:27,219 - DEBUG - Requesting: http://10.0.0.22:8082/port-tuple/4b837195-1689-4ee0-a052-5afd78888cf9 2025-03-13 02:22:27,232 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/2ae1d29b-8046-49e6-b21a-37ce8cc3d656 2025-03-13 02:22:27,251 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/4e9e3a30-cebf-4033-95c5-4c802800248c 2025-03-13 02:22:27,268 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/99af1a1a-cdb0-4a8f-9211-49d43dc0072b 2025-03-13 02:22:27,601 - DEBUG - VM is in ACTIVE state now 2025-03-13 02:22:28,191 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine/a96a7874-e1fa-444e-ba39-e2daaff3392b 2025-03-13 02:22:28,205 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine-interface/2ae1d29b-8046-49e6-b21a-37ce8cc3d656 2025-03-13 02:22:28,225 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine-interface/4e9e3a30-cebf-4033-95c5-4c802800248c 2025-03-13 02:22:28,248 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine-interface/99af1a1a-cdb0-4a8f-9211-49d43dc0072b 2025-03-13 02:22:28,265 - DEBUG - Requesting: http://10.0.0.36:8082/instance-ip/0ca77f32-8f45-49ed-8d14-9c4d37276a77 2025-03-13 02:22:28,287 - DEBUG - Requesting: http://10.0.0.36:8082/instance-ip/765749cd-5f9f-4973-a274-9f3f70b32fec 2025-03-13 02:22:28,304 - DEBUG - Requesting: http://10.0.0.36:8082/instance-ip/a9b6a4e3-6303-458a-b48e-705414d1960b 2025-03-13 02:22:28,322 - DEBUG - Requesting: http://10.0.0.36:8082/instance-ip/30d1924c-7da5-411c-9a5e-b0b82051569f 2025-03-13 02:22:28,342 - DEBUG - Requesting: http://10.0.0.36:8082/instance-ip/4f6571d7-e0ad-4715-bbde-56487a38c170 2025-03-13 02:22:28,357 - DEBUG - Requesting: http://10.0.0.36:8082/instance-ip/880a9eef-743b-4e5d-85f1-feb0ab1bfb13 2025-03-13 02:22:28,371 - DEBUG - Requesting: http://10.0.0.36:8082/instance-ip/3b2cb0c2-7739-4ba1-9113-180f0671d92c 2025-03-13 02:22:28,385 - DEBUG - Requesting: http://10.0.0.36:8082/instance-ip/3c28763b-7b78-40d8-9fce-dffbbc8094d3 2025-03-13 02:22:28,401 - DEBUG - Requesting: http://10.0.0.36:8082/instance-ip/6e5ec93f-68f9-4cfa-88c7-9c56fb6d9c03 2025-03-13 02:22:29,008 - DEBUG - VM is in ACTIVE state now 2025-03-13 02:22:29,008 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine/a96a7874-e1fa-444e-ba39-e2daaff3392b 2025-03-13 02:22:29,023 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine-interface/2ae1d29b-8046-49e6-b21a-37ce8cc3d656 2025-03-13 02:22:29,037 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine-interface/4e9e3a30-cebf-4033-95c5-4c802800248c 2025-03-13 02:22:29,053 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-machine-interface/99af1a1a-cdb0-4a8f-9211-49d43dc0072b 2025-03-13 02:22:30,286 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=1.94 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.457 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.457/1.196/1.935/0.739 ms') 2025-03-13 02:22:30,286 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-96930215 passed 2025-03-13 02:22:30,352 - DEBUG - VM ctest-pt_svm0-96930215 Tap interface: {'index': '5', 'name': 'tap2ae1d29b-80', 'uuid': '2ae1d29b-8046-49e6-b21a-37ce8cc3d656', 'vrf_name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462:ctest-left_vn-47852462', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462', 'vm_uuid': 'a96a7874-e1fa-444e-ba39-e2daaff3392b', 'vm_name': 'ctest-pt_svm0-96930215', 'ip_addr': '34.191.15.68', 'mac_addr': '02:2a:e1:d2:9b:80', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-25656382:2ae1d29b-8046-49e6-b21a-37ce8cc3d656', 'sg_uuid_list': ['b6ebc245-6843-4e6f-a4c7-cab8f39a227f'], 'static_route_list': None, 'vm_project_uuid': '45c29f1d-a278-4742-8111-53394f79f8bb', 'admin_state': 'Enabled', 'flow_key_idx': '51', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '4e9e3a30-cebf-4033-95c5-4c802800248c', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-03-13 02:22:30,352 - DEBUG - Agent 10.0.0.48 vrf name: default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462:ctest-left_vn-47852462 2025-03-13 02:22:30,360 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462:ctest-left_vn-47852462', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462', 'table_label': '-1', 'vxlan_id': '9', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.7:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-03-13 02:22:30,504 - DEBUG - VM ctest-pt_svm0-96930215 : Tap interface tap2ae1d29b-80 is set to Active 2025-03-13 02:22:30,505 - DEBUG - Tap interface tap2ae1d29b-80 detail : {'index': '5', 'name': 'tap2ae1d29b-80', 'uuid': '2ae1d29b-8046-49e6-b21a-37ce8cc3d656', 'vrf_name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462:ctest-left_vn-47852462', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462', 'vm_uuid': 'a96a7874-e1fa-444e-ba39-e2daaff3392b', 'vm_name': 'ctest-pt_svm0-96930215', 'ip_addr': '34.191.15.68', 'mac_addr': '02:2a:e1:d2:9b:80', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-25656382:2ae1d29b-8046-49e6-b21a-37ce8cc3d656', 'sg_uuid_list': ['b6ebc245-6843-4e6f-a4c7-cab8f39a227f'], 'static_route_list': None, 'vm_project_uuid': '45c29f1d-a278-4742-8111-53394f79f8bb', 'admin_state': 'Enabled', 'flow_key_idx': '51', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '4e9e3a30-cebf-4033-95c5-4c802800248c', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-03-13 02:22:30,671 - DEBUG - Starting Layer 2 verification in Agent 2025-03-13 02:22:30,685 - DEBUG - Layer 2 path is seen for VM MAC 02:2a:e1:d2:9b:80 in agent 10.0.0.48 2025-03-13 02:22:30,685 - DEBUG - Active layer 2 route in agent is present for VMI tap2ae1d29b-80 2025-03-13 02:22:30,685 - DEBUG - L2 label(43) matches bw route table and interface table 2025-03-13 02:22:30,692 - DEBUG - VN default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462 is found in Agent of node 10.0.0.48 2025-03-13 02:22:30,884 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462 is consistent in agent 10.0.0.48 2025-03-13 02:22:30,884 - DEBUG - Route for VM IP ['34.191.15.68'] is consistent in agent 10.0.0.48 2025-03-13 02:22:30,884 - DEBUG - VN default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462 verification for VM ctest-pt_svm0-96930215 in Agent 10.0.0.48 passed 2025-03-13 02:22:31,059 - DEBUG - Starting all layer 2 verification in agent 10.0.0.48 2025-03-13 02:22:31,078 - DEBUG - Route for VM MAC 02:2a:e1:d2:9b:80 is consistent in agent 10.0.0.48 2025-03-13 02:22:31,119 - DEBUG - VM ctest-pt_svm0-96930215 Tap interface: {'index': '4', 'name': 'tap99af1a1a-cd', 'uuid': '99af1a1a-cdb0-4a8f-9211-49d43dc0072b', 'vrf_name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785:ctest-mgmt_vn-78492785', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '34', 'l2_label': '38', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785', 'vm_uuid': 'a96a7874-e1fa-444e-ba39-e2daaff3392b', 'vm_name': 'ctest-pt_svm0-96930215', 'ip_addr': '221.220.47.67', 'mac_addr': '02:99:af:1a:1a:cd', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '27', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-25656382:99af1a1a-cdb0-4a8f-9211-49d43dc0072b', 'sg_uuid_list': ['b6ebc245-6843-4e6f-a4c7-cab8f39a227f'], 'static_route_list': None, 'vm_project_uuid': '45c29f1d-a278-4742-8111-53394f79f8bb', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-03-13 02:22:31,119 - DEBUG - Agent 10.0.0.48 vrf name: default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785:ctest-mgmt_vn-78492785 2025-03-13 02:22:31,128 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785:ctest-mgmt_vn-78492785', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785', 'table_label': '-1', 'vxlan_id': '8', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.7:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-03-13 02:22:31,274 - DEBUG - VM ctest-pt_svm0-96930215 : Tap interface tap99af1a1a-cd is set to Active 2025-03-13 02:22:31,274 - DEBUG - Tap interface tap99af1a1a-cd detail : {'index': '4', 'name': 'tap99af1a1a-cd', 'uuid': '99af1a1a-cdb0-4a8f-9211-49d43dc0072b', 'vrf_name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785:ctest-mgmt_vn-78492785', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '34', 'l2_label': '38', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785', 'vm_uuid': 'a96a7874-e1fa-444e-ba39-e2daaff3392b', 'vm_name': 'ctest-pt_svm0-96930215', 'ip_addr': '221.220.47.67', 'mac_addr': '02:99:af:1a:1a:cd', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '27', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-25656382:99af1a1a-cdb0-4a8f-9211-49d43dc0072b', 'sg_uuid_list': ['b6ebc245-6843-4e6f-a4c7-cab8f39a227f'], 'static_route_list': None, 'vm_project_uuid': '45c29f1d-a278-4742-8111-53394f79f8bb', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-03-13 02:22:31,450 - DEBUG - Starting Layer 2 verification in Agent 2025-03-13 02:22:31,466 - DEBUG - Layer 2 path is seen for VM MAC 02:99:af:1a:1a:cd in agent 10.0.0.48 2025-03-13 02:22:31,466 - DEBUG - Active layer 2 route in agent is present for VMI tap99af1a1a-cd 2025-03-13 02:22:31,466 - DEBUG - L2 label(38) matches bw route table and interface table 2025-03-13 02:22:31,474 - DEBUG - VN default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785 is found in Agent of node 10.0.0.48 2025-03-13 02:22:31,663 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785 is consistent in agent 10.0.0.48 2025-03-13 02:22:31,663 - DEBUG - Route for VM IP ['221.220.47.67'] is consistent in agent 10.0.0.48 2025-03-13 02:22:31,663 - DEBUG - VN default-domain:ctest-TestSvcRegr-25656382:ctest-mgmt_vn-78492785 verification for VM ctest-pt_svm0-96930215 in Agent 10.0.0.48 passed 2025-03-13 02:22:31,830 - DEBUG - Starting all layer 2 verification in agent 10.0.0.48 2025-03-13 02:22:31,843 - DEBUG - Route for VM MAC 02:99:af:1a:1a:cd is consistent in agent 10.0.0.48 2025-03-13 02:22:31,881 - DEBUG - VM ctest-pt_svm0-96930215 Tap interface: {'index': '6', 'name': 'tap4e9e3a30-ce', 'uuid': '4e9e3a30-cebf-4033-95c5-4c802800248c', 'vrf_name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636:ctest-right_vn-74032636', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636', 'vm_uuid': 'a96a7874-e1fa-444e-ba39-e2daaff3392b', 'vm_name': 'ctest-pt_svm0-96930215', 'ip_addr': '213.50.42.196', 'mac_addr': '02:4e:9e:3a:30:ce', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-25656382:4e9e3a30-cebf-4033-95c5-4c802800248c', 'sg_uuid_list': ['b6ebc245-6843-4e6f-a4c7-cab8f39a227f'], 'static_route_list': None, 'vm_project_uuid': '45c29f1d-a278-4742-8111-53394f79f8bb', 'admin_state': 'Enabled', 'flow_key_idx': '57', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '2ae1d29b-8046-49e6-b21a-37ce8cc3d656', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-03-13 02:22:31,882 - DEBUG - Agent 10.0.0.48 vrf name: default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636:ctest-right_vn-74032636 2025-03-13 02:22:31,889 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636:ctest-right_vn-74032636', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636', 'table_label': '-1', 'vxlan_id': '10', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.7:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-03-13 02:22:32,042 - DEBUG - VM ctest-pt_svm0-96930215 : Tap interface tap4e9e3a30-ce is set to Active 2025-03-13 02:22:32,042 - DEBUG - Tap interface tap4e9e3a30-ce detail : {'index': '6', 'name': 'tap4e9e3a30-ce', 'uuid': '4e9e3a30-cebf-4033-95c5-4c802800248c', 'vrf_name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636:ctest-right_vn-74032636', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636', 'vm_uuid': 'a96a7874-e1fa-444e-ba39-e2daaff3392b', 'vm_name': 'ctest-pt_svm0-96930215', 'ip_addr': '213.50.42.196', 'mac_addr': '02:4e:9e:3a:30:ce', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-25656382:4e9e3a30-cebf-4033-95c5-4c802800248c', 'sg_uuid_list': ['b6ebc245-6843-4e6f-a4c7-cab8f39a227f'], 'static_route_list': None, 'vm_project_uuid': '45c29f1d-a278-4742-8111-53394f79f8bb', 'admin_state': 'Enabled', 'flow_key_idx': '57', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '2ae1d29b-8046-49e6-b21a-37ce8cc3d656', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-03-13 02:22:32,211 - DEBUG - Starting Layer 2 verification in Agent 2025-03-13 02:22:32,225 - DEBUG - Layer 2 path is seen for VM MAC 02:4e:9e:3a:30:ce in agent 10.0.0.48 2025-03-13 02:22:32,225 - DEBUG - Active layer 2 route in agent is present for VMI tap4e9e3a30-ce 2025-03-13 02:22:32,225 - DEBUG - L2 label(48) matches bw route table and interface table 2025-03-13 02:22:32,232 - DEBUG - VN default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636 is found in Agent of node 10.0.0.48 2025-03-13 02:22:32,423 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636 is consistent in agent 10.0.0.48 2025-03-13 02:22:32,423 - DEBUG - Route for VM IP ['213.50.42.196'] is consistent in agent 10.0.0.48 2025-03-13 02:22:32,423 - DEBUG - VN default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636 verification for VM ctest-pt_svm0-96930215 in Agent 10.0.0.48 passed 2025-03-13 02:22:32,602 - DEBUG - Starting all layer 2 verification in agent 10.0.0.48 2025-03-13 02:22:32,617 - DEBUG - Route for VM MAC 02:4e:9e:3a:30:ce is consistent in agent 10.0.0.48 2025-03-13 02:22:32,625 - DEBUG - VN default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636 is found in Agent of node 10.0.0.23 2025-03-13 02:22:32,821 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636 is consistent in agent 10.0.0.23 2025-03-13 02:22:32,821 - DEBUG - Route for VM IP ['213.50.42.196'] is consistent in agent 10.0.0.23 2025-03-13 02:22:32,822 - DEBUG - VN default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636 verification for VM ctest-pt_svm0-96930215 in Agent 10.0.0.23 passed 2025-03-13 02:22:32,986 - DEBUG - Starting all layer 2 verification in agent 10.0.0.23 2025-03-13 02:22:33,005 - DEBUG - Route for VM MAC 02:4e:9e:3a:30:ce is consistent in agent 10.0.0.23 2025-03-13 02:22:33,005 - INFO - VM ctest-pt_svm0-96930215 verifications in Compute nodes passed 2025-03-13 02:22:33,005 - DEBUG - The SVMs in the SI are : [] 2025-03-13 02:22:33,006 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/a96a7874-e1fa-444e-ba39-e2daaff3392b 2025-03-13 02:22:33,027 - DEBUG - Service VM for SI 'ctest-si-17221843' is launched 2025-03-13 02:22:33,028 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:22:33,042 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:22:33,068 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:22:33,211 - DEBUG - Requesting: http://10.0.0.22:8082/service-instance/0b4ba8b0-4d5f-4fc9-9c10-cd908ea98a79 2025-03-13 02:22:33,226 - DEBUG - SI ctest-si-17221843 has Port Tuple: ['ctest-port_tuple-86718551'] 2025-03-13 02:22:33,256 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-25656382:ctest-left_vn-47852462 2025-03-13 02:22:33,328 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-25656382:ctest-right_vn-74032636 2025-03-13 02:22:33,413 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:33,426 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:33,426 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:33,433 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:33,433 - INFO - Route to 213.50.42.195 seen in VRF:5 on an-jenkins-deploy-platform-ansible-os-2857-1, and SI ctest-si-17221843 is seen as the NH 2025-03-13 02:22:33,529 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:33,545 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:33,545 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:33,553 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:33,553 - INFO - Route to 34.191.15.67 seen in VRF:6 on an-jenkins-deploy-platform-ansible-os-2857-1, and SI ctest-si-17221843 is seen as the NH 2025-03-13 02:22:33,553 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:33,554 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-13 02:22:33,554 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 213.50.42.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-03-13 02:22:33,554 - DEBUG - ping -s 56 -c 3 -W 1 213.50.42.195 2025-03-13 02:22:37,228 - DEBUG - PING 213.50.42.195 (213.50.42.195): 56 data bytes 64 bytes from 213.50.42.195: seq=0 ttl=61 time=8.283 ms 64 bytes from 213.50.42.195: seq=1 ttl=61 time=2.124 ms 64 bytes from 213.50.42.195: seq=2 ttl=61 time=2.091 ms --- 213.50.42.195 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 2.091/4.166/8.283 ms 2025-03-13 02:22:37,229 - INFO - Ping to IP 213.50.42.195 from VM ctest-left_vm-81039376 passed 2025-03-13 02:22:37,229 - INFO - Dettaching policy ctest-policy-59482655 from vn ctest-right_vn-74032636 2025-03-13 02:22:37,448 - INFO - Dettaching policy ctest-policy-59482655 from vn ctest-left_vn-47852462 2025-03-13 02:22:37,849 - INFO - Deleted policy ctest-policy-59482655 2025-03-13 02:22:37,849 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-25656382', 'ctest-si-17221843'] 2025-03-13 02:22:38,058 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-25656382', 'ctest-si-17221843'] 2025-03-13 02:22:38,058 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:22:38,069 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:22:38,109 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:22:38,229 - DEBUG - Service instance ctest-si-17221843 removed from api server 2025-03-13 02:22:38,229 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/a96a7874-e1fa-444e-ba39-e2daaff3392b 2025-03-13 02:22:38,244 - DEBUG - All Service VMs unlinked from SI ctest-si-17221843 2025-03-13 02:22:38,252 - DEBUG - 0 svc intances found in all projects. They are [] 2025-03-13 02:22:38,252 - DEBUG - 0 svc intances found in current project. They are [] 2025-03-13 02:22:38,307 - DEBUG - 0 svc intances found in all projects. They are [] 2025-03-13 02:22:38,307 - DEBUG - 0 svc intances found in current project. They are [] 2025-03-13 02:22:38,307 - INFO - Deleting VM ctest-pt_svm0-96930215 2025-03-13 02:22:38,454 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-10866697'] 2025-03-13 02:22:38,631 - INFO - Service template: ['default-domain', 'ctest-service_template_1-10866697'] deleted successfully. 2025-03-13 02:22:38,631 - INFO - Deleting VM ctest-right_vm-46737236 2025-03-13 02:22:38,860 - INFO - Deleting VM ctest-left_vm-81039376 2025-03-13 02:22:39,026 - INFO - Deleting VN ctest-right_vn-74032636 2025-03-13 02:22:39,091 - DEBUG - VN 1474c8f3-388a-401b-a913-54d63e07e3b5 still in use: Unable to complete operation on network 1474c8f3-388a-401b-a913-54d63e07e3b5. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-78a02872-44b2-43ff-a4ca-00296bfae8b9'] 2025-03-13 02:22:39,091 - WARNING - Deleting VN ctest-right_vn-74032636 failed..Will retry 2025-03-13 02:22:41,297 - DEBUG - Response for deleting network () 2025-03-13 02:22:41,297 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/9fa89df0-409b-406c-baa9-1d5f3fe9099d 2025-03-13 02:22:41,305 - DEBUG - Response Code: 404 2025-03-13 02:22:41,305 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:22:41,313 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:22:41,349 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:22:41,458 - INFO - Validated that VN ctest-right_vn-74032636 is not found in API Server 2025-03-13 02:22:41,473 - DEBUG - VN ctest-right_vn-74032636 is not present in Agent 10.0.0.48 2025-03-13 02:22:41,486 - DEBUG - VN ctest-right_vn-74032636 is not present in Agent 10.0.0.23 2025-03-13 02:22:41,486 - INFO - Validated that VN ctest-right_vn-74032636 is not in any agent 2025-03-13 02:22:41,527 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-74032636 info 2025-03-13 02:22:41,527 - INFO - Deleting VN ctest-left_vn-47852462 2025-03-13 02:22:41,733 - DEBUG - Response for deleting network () 2025-03-13 02:22:41,733 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/90603425-8633-4fc4-9606-d0d1c7f30b5e 2025-03-13 02:22:41,740 - DEBUG - Response Code: 404 2025-03-13 02:22:41,740 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:22:41,749 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:22:41,807 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:22:41,916 - INFO - Validated that VN ctest-left_vn-47852462 is not found in API Server 2025-03-13 02:22:41,930 - DEBUG - VN ctest-left_vn-47852462 is not present in Agent 10.0.0.48 2025-03-13 02:22:41,945 - DEBUG - VN ctest-left_vn-47852462 is not present in Agent 10.0.0.23 2025-03-13 02:22:41,945 - INFO - Validated that VN ctest-left_vn-47852462 is not in any agent 2025-03-13 02:22:42,004 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-47852462 info 2025-03-13 02:22:42,004 - INFO - Deleting VN ctest-mgmt_vn-78492785 2025-03-13 02:22:42,235 - DEBUG - Response for deleting network () 2025-03-13 02:22:42,235 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/5853cc06-b3a2-4a44-bf4f-402035429747 2025-03-13 02:22:42,249 - DEBUG - Response Code: 404 2025-03-13 02:22:42,249 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-03-13 02:22:42,260 - DEBUG - Requesting: http://10.0.0.22:8082/domain/7073dd22-c5ea-4305-beca-a7c1118b823d 2025-03-13 02:22:42,276 - DEBUG - Requesting: http://10.0.0.22:8082/project/45c29f1d-a278-4742-8111-53394f79f8bb 2025-03-13 02:22:42,377 - INFO - Validated that VN ctest-mgmt_vn-78492785 is not found in API Server 2025-03-13 02:22:42,408 - DEBUG - VN ctest-mgmt_vn-78492785 is not present in Agent 10.0.0.48 2025-03-13 02:22:42,427 - DEBUG - VN ctest-mgmt_vn-78492785 is not present in Agent 10.0.0.23 2025-03-13 02:22:42,427 - INFO - Validated that VN ctest-mgmt_vn-78492785 is not in any agent 2025-03-13 02:22:42,480 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-78492785 info 2025-03-13 02:22:43,802 - DEBUG - No XMPP flaps were noticed during the test 2025-03-13 02:22:43,803 - INFO - 2025-03-13 02:22:43,803 - INFO - END TEST : test_svc_in_network_datapath : PASSED[0:01:26] 2025-03-13 02:22:43,803 - INFO - -------------------------------------------------------------------------------- 2025-03-13 02:22:44,631 - INFO - Deleted project: ctest-TestSvcRegr-25656382, ID : 45c29f1d-a278-4742-8111-53394f79f8bb