2025-06-16 12:54:55,123 - INFO - Domain Default found not creating 2025-06-16 12:54:55,286 - INFO - Project ctest-TestSvcRegr-04460463 not found, creating it 2025-06-16 12:54:55,747 - INFO - Created Project:ctest-TestSvcRegr-04460463, ID : f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:54:57,289 - INFO - ================================================================================ 2025-06-16 12:54:57,290 - INFO - STARTING TEST : test_svc_in_network_datapath 2025-06-16 12:54:57,547 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with 2025-06-16 12:54:57,547 - INFO - Initial checks done. Running the testcase now 2025-06-16 12:54:57,547 - INFO - 2025-06-16 12:54:58,160 - DEBUG - Response for create_network : {'network': {'id': '0f235b18-b175-4cff-a1d6-216a4ef846d4', 'name': 'ctest-mgmt_vn-39236814', 'tenant_id': 'f948994a44fc468daa8222caecb5ceda', 'project_id': 'f948994a44fc468daa8222caecb5ceda', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-04460463', 'ctest-mgmt_vn-39236814'], 'port_security_enabled': True, 'description': ''}} 2025-06-16 12:54:58,327 - DEBUG - Response for create_subnet : {'subnet': {'id': '40be8baa-2c5d-4499-bd09-87a888ab8e5c', 'name': '', 'tenant_id': 'f948994a44fc468daa8222caecb5ceda', 'network_id': '0f235b18-b175-4cff-a1d6-216a4ef846d4', 'ip_version': 4, 'cidr': '170.32.159.192/26', 'allocation_pools': [{'start': '170.32.159.194', 'end': '170.32.159.254'}], 'gateway_ip': '170.32.159.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '170.32.159.194', 'tags': [], 'project_id': 'f948994a44fc468daa8222caecb5ceda'}} 2025-06-16 12:54:58,348 - INFO - Created VN ctest-mgmt_vn-39236814 2025-06-16 12:54:58,400 - DEBUG - VN ctest-mgmt_vn-39236814 UUID is 0f235b18-b175-4cff-a1d6-216a4ef846d4 2025-06-16 12:54:58,509 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:54:58,847 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:54:58,877 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:54:58,891 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:54:58,972 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0f235b18-b175-4cff-a1d6-216a4ef846d4 2025-06-16 12:54:58,984 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0f235b18-b175-4cff-a1d6-216a4ef846d4 2025-06-16 12:54:58,995 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c5119302-19e4-47b9-8140-8b6e136c0717 2025-06-16 12:54:59,003 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c5119302-19e4-47b9-8140-8b6e136c0717 2025-06-16 12:54:59,011 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/1a576a65-787c-4ca8-a62b-7aee03a59fce 2025-06-16 12:54:59,018 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-06-16 12:54:59,018 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0f235b18-b175-4cff-a1d6-216a4ef846d4 2025-06-16 12:54:59,028 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c5119302-19e4-47b9-8140-8b6e136c0717 2025-06-16 12:54:59,042 - INFO - Verified VN network id 8 for VN 0f235b18-b175-4cff-a1d6-216a4ef846d4 2025-06-16 12:54:59,042 - INFO - Verifications in API Server for VN ctest-mgmt_vn-39236814 passed 2025-06-16 12:54:59,042 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0f235b18-b175-4cff-a1d6-216a4ef846d4 2025-06-16 12:54:59,052 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c5119302-19e4-47b9-8140-8b6e136c0717 2025-06-16 12:54:59,059 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c5119302-19e4-47b9-8140-8b6e136c0717 2025-06-16 12:54:59,067 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/1a576a65-787c-4ca8-a62b-7aee03a59fce 2025-06-16 12:54:59,081 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04460463', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1090815696368389375', 'uuid-lslong': '11661545025597621972'}, 'enable': 'true', 'created': '2025-06-16T12:54:58', 'last-modified': '2025-06-16T12:54:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.787560'} 2025-06-16 12:54:59,090 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-06-16 12:54:59,090 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-39236814 passed 2025-06-16 12:54:59,090 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-39236814 in API_Server ====== 2025-06-16 12:54:59,090 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:54:59,096 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:54:59,109 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:54:59,180 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0f235b18-b175-4cff-a1d6-216a4ef846d4 2025-06-16 12:54:59,190 - DEBUG - =>VN ctest-mgmt_vn-39236814 has no policy to be verified 2025-06-16 12:54:59,191 - DEBUG - Verifying the vn in opserver 2025-06-16 12:54:59,191 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814 virtual network link through opserver 10.0.0.254 2025-06-16 12:54:59,191 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-06-16 12:54:59,521 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-06-16 12:54:59,582 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814?flat'} 2025-06-16 12:54:59,582 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814 is found in opserver 2025-06-16 12:54:59,595 - DEBUG - Do not have enough data to verify VN in agent 2025-06-16 12:54:59,601 - DEBUG - VRF ids for VN ctest-mgmt_vn-39236814: {} 2025-06-16 12:54:59,787 - DEBUG - Response for create_network : {'network': {'id': '61c1c1f5-21fe-40e6-b25b-f5eea445a484', 'name': 'ctest-left_vn-35033079', 'tenant_id': 'f948994a44fc468daa8222caecb5ceda', 'project_id': 'f948994a44fc468daa8222caecb5ceda', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-04460463', 'ctest-left_vn-35033079'], 'port_security_enabled': True, 'description': ''}} 2025-06-16 12:55:00,007 - DEBUG - Response for create_subnet : {'subnet': {'id': '255f5079-b9fd-46a3-9f60-05e269ef6524', 'name': '', 'tenant_id': 'f948994a44fc468daa8222caecb5ceda', 'network_id': '61c1c1f5-21fe-40e6-b25b-f5eea445a484', 'ip_version': 4, 'cidr': '219.234.25.0/26', 'allocation_pools': [{'start': '219.234.25.2', 'end': '219.234.25.62'}], 'gateway_ip': '219.234.25.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '219.234.25.2', 'tags': [], 'project_id': 'f948994a44fc468daa8222caecb5ceda'}} 2025-06-16 12:55:00,027 - INFO - Created VN ctest-left_vn-35033079 2025-06-16 12:55:00,084 - DEBUG - VN ctest-left_vn-35033079 UUID is 61c1c1f5-21fe-40e6-b25b-f5eea445a484 2025-06-16 12:55:00,198 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:55:00,204 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:55:00,217 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:55:00,306 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/61c1c1f5-21fe-40e6-b25b-f5eea445a484 2025-06-16 12:55:00,318 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/61c1c1f5-21fe-40e6-b25b-f5eea445a484 2025-06-16 12:55:00,328 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/43c5e5f1-4f80-407d-a034-753165d0ff45 2025-06-16 12:55:00,336 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/43c5e5f1-4f80-407d-a034-753165d0ff45 2025-06-16 12:55:00,344 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/bfc15fa3-8a2e-4e6a-88f6-488d1398f40a 2025-06-16 12:55:00,354 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-06-16 12:55:00,354 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/61c1c1f5-21fe-40e6-b25b-f5eea445a484 2025-06-16 12:55:00,365 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/43c5e5f1-4f80-407d-a034-753165d0ff45 2025-06-16 12:55:00,380 - INFO - Verified VN network id 9 for VN 61c1c1f5-21fe-40e6-b25b-f5eea445a484 2025-06-16 12:55:00,381 - INFO - Verifications in API Server for VN ctest-left_vn-35033079 passed 2025-06-16 12:55:00,381 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/61c1c1f5-21fe-40e6-b25b-f5eea445a484 2025-06-16 12:55:00,391 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/43c5e5f1-4f80-407d-a034-753165d0ff45 2025-06-16 12:55:00,399 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/43c5e5f1-4f80-407d-a034-753165d0ff45 2025-06-16 12:55:00,406 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/bfc15fa3-8a2e-4e6a-88f6-488d1398f40a 2025-06-16 12:55:00,419 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04460463', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7044124550765625574', 'uuid-lslong': '12852136366938891396'}, 'enable': 'true', 'created': '2025-06-16T12:54:59', 'last-modified': '2025-06-16T12:54:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.465045'} 2025-06-16 12:55:00,426 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-06-16 12:55:00,426 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-35033079 passed 2025-06-16 12:55:00,426 - DEBUG - ====Verifying policy data for ctest-left_vn-35033079 in API_Server ====== 2025-06-16 12:55:00,426 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:55:00,432 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:55:00,445 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:55:00,522 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/61c1c1f5-21fe-40e6-b25b-f5eea445a484 2025-06-16 12:55:00,533 - DEBUG - =>VN ctest-left_vn-35033079 has no policy to be verified 2025-06-16 12:55:00,533 - DEBUG - Verifying the vn in opserver 2025-06-16 12:55:00,533 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079 virtual network link through opserver 10.0.0.254 2025-06-16 12:55:00,533 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-06-16 12:55:00,553 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079?flat'} 2025-06-16 12:55:00,553 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079 is found in opserver 2025-06-16 12:55:00,569 - DEBUG - Do not have enough data to verify VN in agent 2025-06-16 12:55:00,577 - DEBUG - VRF ids for VN ctest-left_vn-35033079: {} 2025-06-16 12:55:00,777 - DEBUG - Response for create_network : {'network': {'id': 'ff266189-9656-47c0-a99f-75dcce32b1fb', 'name': 'ctest-right_vn-74348099', 'tenant_id': 'f948994a44fc468daa8222caecb5ceda', 'project_id': 'f948994a44fc468daa8222caecb5ceda', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-04460463', 'ctest-right_vn-74348099'], 'port_security_enabled': True, 'description': ''}} 2025-06-16 12:55:00,963 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c3be1b20-f8ce-428b-a14e-dc80472d0286', 'name': '', 'tenant_id': 'f948994a44fc468daa8222caecb5ceda', 'network_id': 'ff266189-9656-47c0-a99f-75dcce32b1fb', 'ip_version': 4, 'cidr': '74.54.65.64/26', 'allocation_pools': [{'start': '74.54.65.66', 'end': '74.54.65.126'}], 'gateway_ip': '74.54.65.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '74.54.65.66', 'tags': [], 'project_id': 'f948994a44fc468daa8222caecb5ceda'}} 2025-06-16 12:55:00,987 - INFO - Created VN ctest-right_vn-74348099 2025-06-16 12:55:01,048 - DEBUG - VN ctest-right_vn-74348099 UUID is ff266189-9656-47c0-a99f-75dcce32b1fb 2025-06-16 12:55:01,166 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:55:01,172 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:55:01,186 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:55:01,266 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ff266189-9656-47c0-a99f-75dcce32b1fb 2025-06-16 12:55:01,278 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ff266189-9656-47c0-a99f-75dcce32b1fb 2025-06-16 12:55:01,289 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e1addff8-e8ef-405a-b42c-b7f994a80490 2025-06-16 12:55:01,298 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e1addff8-e8ef-405a-b42c-b7f994a80490 2025-06-16 12:55:01,308 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/35464bee-20ae-4737-9b62-e8ccfc9dddc7 2025-06-16 12:55:01,317 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-06-16 12:55:01,317 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ff266189-9656-47c0-a99f-75dcce32b1fb 2025-06-16 12:55:01,336 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e1addff8-e8ef-405a-b42c-b7f994a80490 2025-06-16 12:55:01,360 - INFO - Verified VN network id 10 for VN ff266189-9656-47c0-a99f-75dcce32b1fb 2025-06-16 12:55:01,360 - INFO - Verifications in API Server for VN ctest-right_vn-74348099 passed 2025-06-16 12:55:01,360 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ff266189-9656-47c0-a99f-75dcce32b1fb 2025-06-16 12:55:01,377 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e1addff8-e8ef-405a-b42c-b7f994a80490 2025-06-16 12:55:01,388 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e1addff8-e8ef-405a-b42c-b7f994a80490 2025-06-16 12:55:01,399 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/35464bee-20ae-4737-9b62-e8ccfc9dddc7 2025-06-16 12:55:01,414 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04460463', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18385489772347279296', 'uuid-lslong': '12222617504919499259'}, 'enable': 'true', 'created': '2025-06-16T12:55:00', 'last-modified': '2025-06-16T12:55:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.492184'} 2025-06-16 12:55:01,421 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-06-16 12:55:01,421 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-74348099 passed 2025-06-16 12:55:01,421 - DEBUG - ====Verifying policy data for ctest-right_vn-74348099 in API_Server ====== 2025-06-16 12:55:01,421 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:55:01,428 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:55:01,442 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:55:01,525 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ff266189-9656-47c0-a99f-75dcce32b1fb 2025-06-16 12:55:01,536 - DEBUG - =>VN ctest-right_vn-74348099 has no policy to be verified 2025-06-16 12:55:01,536 - DEBUG - Verifying the vn in opserver 2025-06-16 12:55:01,536 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099 virtual network link through opserver 10.0.0.254 2025-06-16 12:55:01,536 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-06-16 12:55:01,548 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099?flat'} 2025-06-16 12:55:01,548 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099 is found in opserver 2025-06-16 12:55:01,560 - DEBUG - Do not have enough data to verify VN in agent 2025-06-16 12:55:01,566 - DEBUG - VRF ids for VN ctest-right_vn-74348099: {} 2025-06-16 12:55:01,625 - DEBUG - Services list from nova: [, , ] 2025-06-16 12:55:02,744 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3456-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3456-1) 2025-06-16 12:55:03,976 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3456-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3456-1) 2025-06-16 12:55:03,976 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-94061947'] 2025-06-16 12:55:04,336 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-94061947'] created succesfully 2025-06-16 12:55:04,680 - DEBUG - Image by name cirros_in_net not found 2025-06-16 12:55:04,681 - DEBUG - Installing image cirros_in_net 2025-06-16 12:55:04,683 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-06-16 12:55:04,683 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-06-16 12:55:04,683 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-06-16 12:55:04,698 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2025-06-16 12:55:04,823 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2025-06-16 12:55:04,823 - DEBUG - Unzip image 2025-06-16 12:55:04,823 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2025-06-16 12:55:04,993 - DEBUG - Try to create image in user context 2025-06-16 12:55:05,244 - DEBUG - Image has been created in user context 2025-06-16 12:55:05,245 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2025-06-16 12:55:05,258 - DEBUG - Downloaded image has been removed 2025-06-16 12:55:05,273 - DEBUG - Uploaded image status = active 2025-06-16 12:55:06,490 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3456-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3456-1) 2025-06-16 12:55:06,491 - INFO - Waiting for VM ctest-pt_svm0-48291734 to be up.. 2025-06-16 12:55:06,543 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-06-16 12:55:11,658 - DEBUG - VM is in ACTIVE state now 2025-06-16 12:55:11,658 - INFO - VM name : ctest-pt_svm0-48291734 2025-06-16 12:55:11,762 - DEBUG - VM ctest-pt_svm0-48291734 ID is a68f90ab-2329-439c-8603-c37caf21f4c9 2025-06-16 12:55:11,784 - DEBUG - VM ctest-pt_svm0-48291734 launched on Node cn-jenkins-deploy-platform-ansible-os-3456-1 2025-06-16 12:55:12,063 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/a68f90ab-2329-439c-8603-c37caf21f4c9 2025-06-16 12:55:12,074 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/0a0b9b80-6830-4afc-bdc2-fe9bb2ebe13e 2025-06-16 12:55:12,086 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/6afbe907-db5f-42b7-b1a6-ad7a6a9a6f0d 2025-06-16 12:55:12,099 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/bc1bc525-773d-49f1-a816-120fb53c44ef 2025-06-16 12:55:15,413 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2025-06-16 12:55:15,413 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-48291734 failed! 2025-06-16 12:55:15,468 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814 is 170.32.159.193 and allocation pool is NOT set 2025-06-16 12:55:19,545 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-06-16 12:55:19,545 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-48291734 failed! 2025-06-16 12:55:19,604 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814 is 170.32.159.193 and allocation pool is NOT set 2025-06-16 12:55:23,670 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-06-16 12:55:23,670 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-48291734 failed! 2025-06-16 12:55:23,724 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814 is 170.32.159.193 and allocation pool is NOT set 2025-06-16 12:55:27,803 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-06-16 12:55:27,804 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-48291734 failed! 2025-06-16 12:55:27,860 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814 is 170.32.159.193 and allocation pool is NOT set 2025-06-16 12:55:29,926 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=4.28 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.751 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.751/2.514/4.278/1.763 ms') 2025-06-16 12:55:29,926 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-48291734 passed 2025-06-16 12:55:30,084 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:55:30,084 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48291734, IP 170.32.159.195, Port 22 2025-06-16 12:55:30,150 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-06-16 12:55:30,233 - DEBUG - VM ctest-pt_svm0-48291734 is NOT ready for SSH connections, VM status: ACTIVE 2025-06-16 12:55:35,234 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:55:35,234 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48291734, IP 170.32.159.195, Port 22 2025-06-16 12:55:35,292 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-06-16 12:55:35,379 - DEBUG - VM ctest-pt_svm0-48291734 is NOT ready for SSH connections, VM status: ACTIVE 2025-06-16 12:55:40,379 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:55:40,379 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48291734, IP 170.32.159.195, Port 22 2025-06-16 12:55:40,435 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-06-16 12:55:40,524 - DEBUG - VM ctest-pt_svm0-48291734 is NOT ready for SSH connections, VM status: ACTIVE 2025-06-16 12:55:45,525 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:55:45,526 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48291734, IP 170.32.159.195, Port 22 2025-06-16 12:55:45,591 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-06-16 12:55:45,686 - DEBUG - VM ctest-pt_svm0-48291734 is NOT ready for SSH connections, VM status: ACTIVE 2025-06-16 12:55:50,687 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:55:50,687 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48291734, IP 170.32.159.195, Port 22 2025-06-16 12:55:50,844 - DEBUG - VM ctest-pt_svm0-48291734 is ready for SSH connections 2025-06-16 12:55:50,996 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:55:50,996 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48291734, IP 170.32.159.195, Port 22 2025-06-16 12:55:51,148 - DEBUG - VM ctest-pt_svm0-48291734 is ready for SSH connections 2025-06-16 12:55:51,301 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:55:51,301 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48291734, IP 170.32.159.195, Port 22 2025-06-16 12:55:51,452 - DEBUG - VM ctest-pt_svm0-48291734 is ready for SSH connections 2025-06-16 12:55:51,458 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-04460463', 'ctest-si-34636336'] 2025-06-16 12:55:52,348 - INFO - Waiting for VM ctest-left_vm-32391826 to be up.. 2025-06-16 12:55:52,425 - DEBUG - VM is in ACTIVE state now 2025-06-16 12:55:52,425 - INFO - VM name : ctest-left_vm-32391826 2025-06-16 12:55:52,507 - DEBUG - VM ctest-left_vm-32391826 ID is bc7a7a16-8a48-449a-9736-e5c8e749c52d 2025-06-16 12:55:52,507 - DEBUG - VM ctest-left_vm-32391826 launched on Node cn-jenkins-deploy-platform-ansible-os-3456-1 2025-06-16 12:55:52,592 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/bc7a7a16-8a48-449a-9736-e5c8e749c52d 2025-06-16 12:55:52,601 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/876df827-873f-44c3-8be8-ddbc364b5a63 2025-06-16 12:55:53,858 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.99 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.353 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.353/1.673/2.993/1.320 ms') 2025-06-16 12:55:53,858 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-32391826 passed 2025-06-16 12:55:54,012 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:55:54,012 - DEBUG - Waiting to SSH to VM ctest-left_vm-32391826, IP 219.234.25.3, Port 22 2025-06-16 12:55:54,167 - DEBUG - VM ctest-left_vm-32391826 is ready for SSH connections 2025-06-16 12:55:54,167 - INFO - Waiting for VM ctest-right_vm-22571758 to be up.. 2025-06-16 12:55:54,250 - DEBUG - VM is in ACTIVE state now 2025-06-16 12:55:54,250 - INFO - VM name : ctest-right_vm-22571758 2025-06-16 12:55:54,327 - DEBUG - VM ctest-right_vm-22571758 ID is 8e406f16-8245-4299-bcc6-2bc72d794eb1 2025-06-16 12:55:54,327 - DEBUG - VM ctest-right_vm-22571758 launched on Node cn-jenkins-deploy-platform-ansible-os-3456-1 2025-06-16 12:55:54,405 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/8e406f16-8245-4299-bcc6-2bc72d794eb1 2025-06-16 12:55:54,414 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/055dc8b3-4bc4-40c4-8f7b-fc5be0b1037a 2025-06-16 12:55:55,657 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.04 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.363 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.363/1.700/3.038/1.337 ms') 2025-06-16 12:55:55,657 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-right_vm-22571758 passed 2025-06-16 12:55:55,808 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:55:55,808 - DEBUG - Waiting to SSH to VM ctest-right_vm-22571758, IP 74.54.65.67, Port 22 2025-06-16 12:55:55,964 - DEBUG - VM ctest-right_vm-22571758 is ready for SSH connections 2025-06-16 12:55:55,970 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-04460463:ctest-si-34636336'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-06-16 12:55:56,412 - INFO - Attaching policy ctest-policy-76612549 to vn ctest-left_vn-35033079 2025-06-16 12:55:56,964 - INFO - Attaching policy ctest-policy-76612549 to vn ctest-right_vn-74348099 2025-06-16 12:55:57,432 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-94061947'] created succesfully 2025-06-16 12:55:57,672 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-04460463', 'ctest-si-34636336'] created succesfully 2025-06-16 12:55:57,673 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:55:57,679 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:55:57,697 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:55:57,787 - DEBUG - Requesting: http://10.0.0.254:8082/service-instance/3475810b-07d6-4d8b-b51b-3d1cdc7015d0 2025-06-16 12:55:57,799 - DEBUG - SI 'ctest-si-34636336' has service template ref to ctest-service_template_1-94061947 2025-06-16 12:55:57,799 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:55:57,805 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:55:57,817 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:55:57,905 - DEBUG - Requesting: http://10.0.0.254:8082/service-instance/3475810b-07d6-4d8b-b51b-3d1cdc7015d0 2025-06-16 12:55:57,918 - DEBUG - Requesting: http://10.0.0.254:8082/port-tuple/57f59401-fbd0-4565-a6d0-d6e2d4509951 2025-06-16 12:55:57,927 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/0a0b9b80-6830-4afc-bdc2-fe9bb2ebe13e 2025-06-16 12:55:57,939 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/6afbe907-db5f-42b7-b1a6-ad7a6a9a6f0d 2025-06-16 12:55:57,955 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/bc1bc525-773d-49f1-a816-120fb53c44ef 2025-06-16 12:55:58,214 - DEBUG - VM is in ACTIVE state now 2025-06-16 12:55:58,652 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/a68f90ab-2329-439c-8603-c37caf21f4c9 2025-06-16 12:55:58,661 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/0a0b9b80-6830-4afc-bdc2-fe9bb2ebe13e 2025-06-16 12:55:58,672 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/6afbe907-db5f-42b7-b1a6-ad7a6a9a6f0d 2025-06-16 12:55:58,683 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/bc1bc525-773d-49f1-a816-120fb53c44ef 2025-06-16 12:55:58,694 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/1d955c9c-b7ac-472c-b101-d3201b94bfc5 2025-06-16 12:55:58,703 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/569dbbcf-e0ec-4d0f-b03b-5dc61f5bf5ef 2025-06-16 12:55:58,710 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/69c071bc-deb7-49d1-a78b-38074a592886 2025-06-16 12:55:58,719 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/27d3428a-9c9d-4a98-9a69-44e33ef1c9aa 2025-06-16 12:55:58,728 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/5cdb2618-4f32-4cbf-b9fc-c48dd20f5f11 2025-06-16 12:55:58,735 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/69a7c3ea-e8cf-41b2-9324-4daff7a641ea 2025-06-16 12:55:58,743 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/113b34a7-ab2c-4554-9585-7e4ee0ceefa0 2025-06-16 12:55:58,751 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/375a2d0f-18da-4892-ba8b-d71f5f1a4774 2025-06-16 12:55:58,760 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/650e5d16-ab99-4c05-a111-f11a2b620203 2025-06-16 12:55:59,174 - DEBUG - VM is in ACTIVE state now 2025-06-16 12:55:59,174 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/a68f90ab-2329-439c-8603-c37caf21f4c9 2025-06-16 12:55:59,182 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/0a0b9b80-6830-4afc-bdc2-fe9bb2ebe13e 2025-06-16 12:55:59,194 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/6afbe907-db5f-42b7-b1a6-ad7a6a9a6f0d 2025-06-16 12:55:59,206 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/bc1bc525-773d-49f1-a816-120fb53c44ef 2025-06-16 12:56:00,443 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=1.02 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.494 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.494/0.755/1.016/0.261 ms') 2025-06-16 12:56:00,443 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-48291734 passed 2025-06-16 12:56:00,483 - DEBUG - VM ctest-pt_svm0-48291734 Tap interface: {'index': '6', 'name': 'tapbc1bc525-77', 'uuid': 'bc1bc525-773d-49f1-a816-120fb53c44ef', 'vrf_name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079:ctest-left_vn-35033079', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079', 'vm_uuid': 'a68f90ab-2329-439c-8603-c37caf21f4c9', 'vm_name': 'ctest-pt_svm0-48291734', 'ip_addr': '219.234.25.4', 'mac_addr': '02:bc:1b:c5:25:77', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-04460463:bc1bc525-773d-49f1-a816-120fb53c44ef', 'sg_uuid_list': ['f3a6cf85-69e6-4fa0-b323-2de7dfccf7b4'], 'static_route_list': None, 'vm_project_uuid': 'f948994a-44fc-468d-aa82-22caecb5ceda', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '6afbe907-db5f-42b7-b1a6-ad7a6a9a6f0d', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-06-16 12:56:00,483 - DEBUG - Agent 10.0.0.254 vrf name: default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079:ctest-left_vn-35033079 2025-06-16 12:56:00,489 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079:ctest-left_vn-35033079', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079', 'table_label': '-1', 'vxlan_id': '9', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.17:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-06-16 12:56:00,659 - DEBUG - VM ctest-pt_svm0-48291734 : Tap interface tapbc1bc525-77 is set to Active 2025-06-16 12:56:00,659 - DEBUG - Tap interface tapbc1bc525-77 detail : {'index': '6', 'name': 'tapbc1bc525-77', 'uuid': 'bc1bc525-773d-49f1-a816-120fb53c44ef', 'vrf_name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079:ctest-left_vn-35033079', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079', 'vm_uuid': 'a68f90ab-2329-439c-8603-c37caf21f4c9', 'vm_name': 'ctest-pt_svm0-48291734', 'ip_addr': '219.234.25.4', 'mac_addr': '02:bc:1b:c5:25:77', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-04460463:bc1bc525-773d-49f1-a816-120fb53c44ef', 'sg_uuid_list': ['f3a6cf85-69e6-4fa0-b323-2de7dfccf7b4'], 'static_route_list': None, 'vm_project_uuid': 'f948994a-44fc-468d-aa82-22caecb5ceda', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '6afbe907-db5f-42b7-b1a6-ad7a6a9a6f0d', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-06-16 12:56:00,852 - DEBUG - Starting Layer 2 verification in Agent 2025-06-16 12:56:00,865 - DEBUG - Layer 2 path is seen for VM MAC 02:bc:1b:c5:25:77 in agent 10.0.0.254 2025-06-16 12:56:00,865 - DEBUG - Active layer 2 route in agent is present for VMI tapbc1bc525-77 2025-06-16 12:56:00,866 - DEBUG - L2 label(48) matches bw route table and interface table 2025-06-16 12:56:00,872 - DEBUG - VN default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079 is found in Agent of node 10.0.0.254 2025-06-16 12:56:01,087 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079 is consistent in agent 10.0.0.254 2025-06-16 12:56:01,089 - DEBUG - Route for VM IP ['219.234.25.4'] is consistent in agent 10.0.0.254 2025-06-16 12:56:01,089 - DEBUG - VN default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079 verification for VM ctest-pt_svm0-48291734 in Agent 10.0.0.254 passed 2025-06-16 12:56:01,284 - DEBUG - Starting all layer 2 verification in agent 10.0.0.254 2025-06-16 12:56:01,305 - DEBUG - Route for VM MAC 02:bc:1b:c5:25:77 is consistent in agent 10.0.0.254 2025-06-16 12:56:01,329 - DEBUG - VM ctest-pt_svm0-48291734 Tap interface: {'index': '5', 'name': 'tap0a0b9b80-68', 'uuid': '0a0b9b80-6830-4afc-bdc2-fe9bb2ebe13e', 'vrf_name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814:ctest-mgmt_vn-39236814', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814', 'vm_uuid': 'a68f90ab-2329-439c-8603-c37caf21f4c9', 'vm_name': 'ctest-pt_svm0-48291734', 'ip_addr': '170.32.159.195', 'mac_addr': '02:0a:0b:9b:80:68', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-04460463:0a0b9b80-6830-4afc-bdc2-fe9bb2ebe13e', 'sg_uuid_list': ['f3a6cf85-69e6-4fa0-b323-2de7dfccf7b4'], 'static_route_list': None, 'vm_project_uuid': 'f948994a-44fc-468d-aa82-22caecb5ceda', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-06-16 12:56:01,329 - DEBUG - Agent 10.0.0.254 vrf name: default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814:ctest-mgmt_vn-39236814 2025-06-16 12:56:01,336 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814:ctest-mgmt_vn-39236814', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814', 'table_label': '-1', 'vxlan_id': '8', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.17:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-06-16 12:56:01,499 - DEBUG - VM ctest-pt_svm0-48291734 : Tap interface tap0a0b9b80-68 is set to Active 2025-06-16 12:56:01,500 - DEBUG - Tap interface tap0a0b9b80-68 detail : {'index': '5', 'name': 'tap0a0b9b80-68', 'uuid': '0a0b9b80-6830-4afc-bdc2-fe9bb2ebe13e', 'vrf_name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814:ctest-mgmt_vn-39236814', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814', 'vm_uuid': 'a68f90ab-2329-439c-8603-c37caf21f4c9', 'vm_name': 'ctest-pt_svm0-48291734', 'ip_addr': '170.32.159.195', 'mac_addr': '02:0a:0b:9b:80:68', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-04460463:0a0b9b80-6830-4afc-bdc2-fe9bb2ebe13e', 'sg_uuid_list': ['f3a6cf85-69e6-4fa0-b323-2de7dfccf7b4'], 'static_route_list': None, 'vm_project_uuid': 'f948994a-44fc-468d-aa82-22caecb5ceda', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-06-16 12:56:01,696 - DEBUG - Starting Layer 2 verification in Agent 2025-06-16 12:56:01,708 - DEBUG - Layer 2 path is seen for VM MAC 02:0a:0b:9b:80:68 in agent 10.0.0.254 2025-06-16 12:56:01,708 - DEBUG - Active layer 2 route in agent is present for VMI tap0a0b9b80-68 2025-06-16 12:56:01,708 - DEBUG - L2 label(43) matches bw route table and interface table 2025-06-16 12:56:01,714 - DEBUG - VN default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814 is found in Agent of node 10.0.0.254 2025-06-16 12:56:01,930 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814 is consistent in agent 10.0.0.254 2025-06-16 12:56:01,930 - DEBUG - Route for VM IP ['170.32.159.195'] is consistent in agent 10.0.0.254 2025-06-16 12:56:01,930 - DEBUG - VN default-domain:ctest-TestSvcRegr-04460463:ctest-mgmt_vn-39236814 verification for VM ctest-pt_svm0-48291734 in Agent 10.0.0.254 passed 2025-06-16 12:56:02,128 - DEBUG - Starting all layer 2 verification in agent 10.0.0.254 2025-06-16 12:56:02,140 - DEBUG - Route for VM MAC 02:0a:0b:9b:80:68 is consistent in agent 10.0.0.254 2025-06-16 12:56:02,162 - DEBUG - VM ctest-pt_svm0-48291734 Tap interface: {'index': '7', 'name': 'tap6afbe907-db', 'uuid': '6afbe907-db5f-42b7-b1a6-ad7a6a9a6f0d', 'vrf_name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099:ctest-right_vn-74348099', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099', 'vm_uuid': 'a68f90ab-2329-439c-8603-c37caf21f4c9', 'vm_name': 'ctest-pt_svm0-48291734', 'ip_addr': '74.54.65.68', 'mac_addr': '02:6a:fb:e9:07:db', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '30', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-04460463:6afbe907-db5f-42b7-b1a6-ad7a6a9a6f0d', 'sg_uuid_list': ['f3a6cf85-69e6-4fa0-b323-2de7dfccf7b4'], 'static_route_list': None, 'vm_project_uuid': 'f948994a-44fc-468d-aa82-22caecb5ceda', 'admin_state': 'Enabled', 'flow_key_idx': '56', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'bc1bc525-773d-49f1-a816-120fb53c44ef', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-06-16 12:56:02,162 - DEBUG - Agent 10.0.0.254 vrf name: default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099:ctest-right_vn-74348099 2025-06-16 12:56:02,167 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099:ctest-right_vn-74348099', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099', 'table_label': '-1', 'vxlan_id': '10', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.17:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-06-16 12:56:02,337 - DEBUG - VM ctest-pt_svm0-48291734 : Tap interface tap6afbe907-db is set to Active 2025-06-16 12:56:02,337 - DEBUG - Tap interface tap6afbe907-db detail : {'index': '7', 'name': 'tap6afbe907-db', 'uuid': '6afbe907-db5f-42b7-b1a6-ad7a6a9a6f0d', 'vrf_name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099:ctest-right_vn-74348099', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099', 'vm_uuid': 'a68f90ab-2329-439c-8603-c37caf21f4c9', 'vm_name': 'ctest-pt_svm0-48291734', 'ip_addr': '74.54.65.68', 'mac_addr': '02:6a:fb:e9:07:db', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '30', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-04460463:6afbe907-db5f-42b7-b1a6-ad7a6a9a6f0d', 'sg_uuid_list': ['f3a6cf85-69e6-4fa0-b323-2de7dfccf7b4'], 'static_route_list': None, 'vm_project_uuid': 'f948994a-44fc-468d-aa82-22caecb5ceda', 'admin_state': 'Enabled', 'flow_key_idx': '56', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'bc1bc525-773d-49f1-a816-120fb53c44ef', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-06-16 12:56:02,532 - DEBUG - Starting Layer 2 verification in Agent 2025-06-16 12:56:02,546 - DEBUG - Layer 2 path is seen for VM MAC 02:6a:fb:e9:07:db in agent 10.0.0.254 2025-06-16 12:56:02,546 - DEBUG - Active layer 2 route in agent is present for VMI tap6afbe907-db 2025-06-16 12:56:02,546 - DEBUG - L2 label(53) matches bw route table and interface table 2025-06-16 12:56:02,554 - DEBUG - VN default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099 is found in Agent of node 10.0.0.254 2025-06-16 12:56:02,774 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099 is consistent in agent 10.0.0.254 2025-06-16 12:56:02,774 - DEBUG - Route for VM IP ['74.54.65.68'] is consistent in agent 10.0.0.254 2025-06-16 12:56:02,774 - DEBUG - VN default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099 verification for VM ctest-pt_svm0-48291734 in Agent 10.0.0.254 passed 2025-06-16 12:56:02,972 - DEBUG - Starting all layer 2 verification in agent 10.0.0.254 2025-06-16 12:56:02,986 - DEBUG - Route for VM MAC 02:6a:fb:e9:07:db is consistent in agent 10.0.0.254 2025-06-16 12:56:02,986 - INFO - VM ctest-pt_svm0-48291734 verifications in Compute nodes passed 2025-06-16 12:56:02,986 - DEBUG - The SVMs in the SI are : [] 2025-06-16 12:56:02,986 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/a68f90ab-2329-439c-8603-c37caf21f4c9 2025-06-16 12:56:02,996 - DEBUG - Service VM for SI 'ctest-si-34636336' is launched 2025-06-16 12:56:02,996 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:56:03,003 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:56:03,017 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:56:03,112 - DEBUG - Requesting: http://10.0.0.254:8082/service-instance/3475810b-07d6-4d8b-b51b-3d1cdc7015d0 2025-06-16 12:56:03,125 - DEBUG - SI ctest-si-34636336 has Port Tuple: ['ctest-port_tuple-15646236'] 2025-06-16 12:56:03,232 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-04460463:ctest-left_vn-35033079 2025-06-16 12:56:03,384 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-04460463:ctest-right_vn-74348099 2025-06-16 12:56:03,544 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:56:03,553 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:56:03,553 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:56:03,560 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:56:03,560 - INFO - Route to 74.54.65.67 seen in VRF:5 on cn-jenkins-deploy-platform-ansible-os-3456-1, and SI ctest-si-34636336 is seen as the NH 2025-06-16 12:56:03,721 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:56:03,730 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:56:03,730 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:56:03,738 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:56:03,738 - INFO - Route to 219.234.25.3 seen in VRF:6 on cn-jenkins-deploy-platform-ansible-os-3456-1, and SI ctest-si-34636336 is seen as the NH 2025-06-16 12:56:03,738 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:56:03,738 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-16 12:56:03,738 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 74.54.65.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.254, gateway password: c0ntrail123 2025-06-16 12:56:03,738 - DEBUG - ping -s 56 -c 3 -W 1 74.54.65.67 2025-06-16 12:56:07,769 - DEBUG - PING 74.54.65.67 (74.54.65.67): 56 data bytes 64 bytes from 74.54.65.67: seq=0 ttl=61 time=5.497 ms 64 bytes from 74.54.65.67: seq=1 ttl=61 time=1.638 ms 64 bytes from 74.54.65.67: seq=2 ttl=61 time=1.608 ms --- 74.54.65.67 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.608/2.914/5.497 ms 2025-06-16 12:56:07,769 - INFO - Ping to IP 74.54.65.67 from VM ctest-left_vm-32391826 passed 2025-06-16 12:56:07,769 - INFO - Dettaching policy ctest-policy-76612549 from vn ctest-right_vn-74348099 2025-06-16 12:56:07,996 - INFO - Dettaching policy ctest-policy-76612549 from vn ctest-left_vn-35033079 2025-06-16 12:56:08,276 - INFO - Deleted policy ctest-policy-76612549 2025-06-16 12:56:08,276 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-04460463', 'ctest-si-34636336'] 2025-06-16 12:56:08,375 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-04460463', 'ctest-si-34636336'] 2025-06-16 12:56:08,376 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:56:08,383 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:56:08,405 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:56:08,486 - DEBUG - Service instance ctest-si-34636336 removed from api server 2025-06-16 12:56:08,486 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/a68f90ab-2329-439c-8603-c37caf21f4c9 2025-06-16 12:56:08,497 - DEBUG - All Service VMs unlinked from SI ctest-si-34636336 2025-06-16 12:56:08,502 - DEBUG - 0 svc intances found in all projects. They are [] 2025-06-16 12:56:08,502 - DEBUG - 0 svc intances found in current project. They are [] 2025-06-16 12:56:08,552 - DEBUG - 0 svc intances found in all projects. They are [] 2025-06-16 12:56:08,552 - DEBUG - 0 svc intances found in current project. They are [] 2025-06-16 12:56:08,552 - INFO - Deleting VM ctest-pt_svm0-48291734 2025-06-16 12:56:08,634 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-94061947'] 2025-06-16 12:56:08,720 - INFO - Service template: ['default-domain', 'ctest-service_template_1-94061947'] deleted successfully. 2025-06-16 12:56:08,720 - INFO - Deleting VM ctest-right_vm-22571758 2025-06-16 12:56:08,817 - INFO - Deleting VM ctest-left_vm-32391826 2025-06-16 12:56:08,904 - INFO - Deleting VN ctest-right_vn-74348099 2025-06-16 12:56:08,944 - DEBUG - VN ff266189-9656-47c0-a99f-75dcce32b1fb still in use: Unable to complete operation on network ff266189-9656-47c0-a99f-75dcce32b1fb. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-79c5dea6-341d-4622-b5fa-bda5dad14797'] 2025-06-16 12:56:08,944 - WARNING - Deleting VN ctest-right_vn-74348099 failed..Will retry 2025-06-16 12:56:11,074 - DEBUG - Response for deleting network () 2025-06-16 12:56:11,074 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e1addff8-e8ef-405a-b42c-b7f994a80490 2025-06-16 12:56:11,081 - DEBUG - Response Code: 404 2025-06-16 12:56:11,081 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:56:11,087 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:56:11,145 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:56:11,228 - INFO - Validated that VN ctest-right_vn-74348099 is not found in API Server 2025-06-16 12:56:11,241 - DEBUG - VN ctest-right_vn-74348099 is not present in Agent 10.0.0.254 2025-06-16 12:56:11,241 - INFO - Validated that VN ctest-right_vn-74348099 is not in any agent 2025-06-16 12:56:11,259 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-74348099 info 2025-06-16 12:56:11,259 - INFO - Deleting VN ctest-left_vn-35033079 2025-06-16 12:56:11,377 - DEBUG - Response for deleting network () 2025-06-16 12:56:11,377 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/43c5e5f1-4f80-407d-a034-753165d0ff45 2025-06-16 12:56:11,386 - DEBUG - Response Code: 404 2025-06-16 12:56:11,386 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:56:11,392 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:56:11,447 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:56:11,520 - INFO - Validated that VN ctest-left_vn-35033079 is not found in API Server 2025-06-16 12:56:11,533 - DEBUG - VN ctest-left_vn-35033079 is not present in Agent 10.0.0.254 2025-06-16 12:56:11,533 - INFO - Validated that VN ctest-left_vn-35033079 is not in any agent 2025-06-16 12:56:11,552 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-35033079 info 2025-06-16 12:56:11,552 - INFO - Deleting VN ctest-mgmt_vn-39236814 2025-06-16 12:56:11,665 - DEBUG - Response for deleting network () 2025-06-16 12:56:11,665 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c5119302-19e4-47b9-8140-8b6e136c0717 2025-06-16 12:56:11,671 - DEBUG - Response Code: 404 2025-06-16 12:56:11,671 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-06-16 12:56:11,681 - DEBUG - Requesting: http://10.0.0.254:8082/domain/be193eb7-9ce6-4a52-85d8-c68282181a68 2025-06-16 12:56:11,742 - DEBUG - Requesting: http://10.0.0.254:8082/project/f948994a-44fc-468d-aa82-22caecb5ceda 2025-06-16 12:56:11,819 - INFO - Validated that VN ctest-mgmt_vn-39236814 is not found in API Server 2025-06-16 12:56:11,834 - DEBUG - VN ctest-mgmt_vn-39236814 is not present in Agent 10.0.0.254 2025-06-16 12:56:11,834 - INFO - Validated that VN ctest-mgmt_vn-39236814 is not in any agent 2025-06-16 12:56:11,851 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-39236814 info 2025-06-16 12:56:12,110 - DEBUG - No XMPP flaps were noticed during the test 2025-06-16 12:56:12,110 - INFO - 2025-06-16 12:56:12,110 - INFO - END TEST : test_svc_in_network_datapath : PASSED[0:01:15] 2025-06-16 12:56:12,111 - INFO - -------------------------------------------------------------------------------- 2025-06-16 12:56:12,856 - INFO - Deleted project: ctest-TestSvcRegr-04460463, ID : f948994a-44fc-468d-aa82-22caecb5ceda