2025-04-14 12:42:18,541 - INFO - Domain Default found not creating 2025-04-14 12:42:18,695 - INFO - Project ctest-TestSvcRegr-93956523 not found, creating it 2025-04-14 12:42:19,443 - INFO - Created Project:ctest-TestSvcRegr-93956523, ID : d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:42:21,032 - INFO - ================================================================================ 2025-04-14 12:42:21,032 - INFO - STARTING TEST : test_svc_in_network_datapath 2025-04-14 12:42:21,295 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0'}} with 2025-04-14 12:42:21,296 - INFO - Initial checks done. Running the testcase now 2025-04-14 12:42:21,296 - INFO - 2025-04-14 12:42:21,915 - DEBUG - Response for create_network : {'network': {'id': '9e1e4500-195f-45cf-8c18-f03d675ac983', 'name': 'ctest-mgmt_vn-60351428', 'tenant_id': 'd088b3deae484f5d95b5d69eb2ecec19', 'project_id': 'd088b3deae484f5d95b5d69eb2ecec19', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-93956523', 'ctest-mgmt_vn-60351428'], 'port_security_enabled': True, 'description': ''}} 2025-04-14 12:42:22,133 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e83343ee-ecab-429a-8284-ba2f4091ab71', 'name': '', 'tenant_id': 'd088b3deae484f5d95b5d69eb2ecec19', 'network_id': '9e1e4500-195f-45cf-8c18-f03d675ac983', 'ip_version': 4, 'cidr': '110.212.222.128/26', 'allocation_pools': [{'start': '110.212.222.130', 'end': '110.212.222.190'}], 'gateway_ip': '110.212.222.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '110.212.222.130', 'tags': [], 'project_id': 'd088b3deae484f5d95b5d69eb2ecec19'}} 2025-04-14 12:42:22,163 - INFO - Created VN ctest-mgmt_vn-60351428 2025-04-14 12:42:22,218 - DEBUG - VN ctest-mgmt_vn-60351428 UUID is 9e1e4500-195f-45cf-8c18-f03d675ac983 2025-04-14 12:42:22,350 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:42:22,643 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:42:22,677 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:42:22,693 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:42:22,774 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/9e1e4500-195f-45cf-8c18-f03d675ac983 2025-04-14 12:42:22,792 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/9e1e4500-195f-45cf-8c18-f03d675ac983 2025-04-14 12:42:22,803 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/56b05619-f4b3-4e58-81db-f0ac70030322 2025-04-14 12:42:22,812 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/56b05619-f4b3-4e58-81db-f0ac70030322 2025-04-14 12:42:22,821 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/9c0e3894-0c41-4ff7-93da-1d5b5f168cf5 2025-04-14 12:42:22,829 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-04-14 12:42:22,829 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/9e1e4500-195f-45cf-8c18-f03d675ac983 2025-04-14 12:42:22,840 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/56b05619-f4b3-4e58-81db-f0ac70030322 2025-04-14 12:42:22,856 - INFO - Verified VN network id 8 for VN 9e1e4500-195f-45cf-8c18-f03d675ac983 2025-04-14 12:42:22,856 - INFO - Verifications in API Server for VN ctest-mgmt_vn-60351428 passed 2025-04-14 12:42:22,856 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/9e1e4500-195f-45cf-8c18-f03d675ac983 2025-04-14 12:42:22,867 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/56b05619-f4b3-4e58-81db-f0ac70030322 2025-04-14 12:42:22,875 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/56b05619-f4b3-4e58-81db-f0ac70030322 2025-04-14 12:42:22,885 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/9c0e3894-0c41-4ff7-93da-1d5b5f168cf5 2025-04-14 12:42:22,901 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-93956523', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11393619974021924303', 'uuid-lslong': '10095082711268641155'}, 'enable': 'true', 'created': '2025-04-14T12:42:21', 'last-modified': '2025-04-14T12:42:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.799726'} 2025-04-14 12:42:22,908 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-04-14 12:42:22,909 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-60351428 passed 2025-04-14 12:42:22,909 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-60351428 in API_Server ====== 2025-04-14 12:42:22,909 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:42:22,918 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:42:22,932 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:42:23,011 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/9e1e4500-195f-45cf-8c18-f03d675ac983 2025-04-14 12:42:23,022 - DEBUG - =>VN ctest-mgmt_vn-60351428 has no policy to be verified 2025-04-14 12:42:23,022 - DEBUG - Verifying the vn in opserver 2025-04-14 12:42:23,022 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428 virtual network link through opserver 10.0.0.48 2025-04-14 12:42:23,022 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-04-14 12:42:23,318 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-04-14 12:42:23,380 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428?flat'} 2025-04-14 12:42:23,380 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428 is found in opserver 2025-04-14 12:42:23,392 - DEBUG - Do not have enough data to verify VN in agent 2025-04-14 12:42:23,399 - DEBUG - VRF ids for VN ctest-mgmt_vn-60351428: {} 2025-04-14 12:42:23,599 - DEBUG - Response for create_network : {'network': {'id': 'd4ee885e-21b9-4dc8-9fc8-471e316c1fd3', 'name': 'ctest-left_vn-04111556', 'tenant_id': 'd088b3deae484f5d95b5d69eb2ecec19', 'project_id': 'd088b3deae484f5d95b5d69eb2ecec19', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-93956523', 'ctest-left_vn-04111556'], 'port_security_enabled': True, 'description': ''}} 2025-04-14 12:42:23,827 - DEBUG - Response for create_subnet : {'subnet': {'id': '5f8cb03f-50c1-48c1-9352-44abe4801339', 'name': '', 'tenant_id': 'd088b3deae484f5d95b5d69eb2ecec19', 'network_id': 'd4ee885e-21b9-4dc8-9fc8-471e316c1fd3', 'ip_version': 4, 'cidr': '70.134.163.192/26', 'allocation_pools': [{'start': '70.134.163.194', 'end': '70.134.163.254'}], 'gateway_ip': '70.134.163.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '70.134.163.194', 'tags': [], 'project_id': 'd088b3deae484f5d95b5d69eb2ecec19'}} 2025-04-14 12:42:23,846 - INFO - Created VN ctest-left_vn-04111556 2025-04-14 12:42:23,902 - DEBUG - VN ctest-left_vn-04111556 UUID is d4ee885e-21b9-4dc8-9fc8-471e316c1fd3 2025-04-14 12:42:24,018 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:42:24,024 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:42:24,036 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:42:24,114 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/d4ee885e-21b9-4dc8-9fc8-471e316c1fd3 2025-04-14 12:42:24,129 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/d4ee885e-21b9-4dc8-9fc8-471e316c1fd3 2025-04-14 12:42:24,142 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/d58b157d-30b9-4f46-81e1-5bda9a70d1e9 2025-04-14 12:42:24,151 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/d58b157d-30b9-4f46-81e1-5bda9a70d1e9 2025-04-14 12:42:24,161 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/b3594839-ec36-4c59-bfd6-3a2d884e88e8 2025-04-14 12:42:24,169 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-04-14 12:42:24,169 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/d4ee885e-21b9-4dc8-9fc8-471e316c1fd3 2025-04-14 12:42:24,180 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/d58b157d-30b9-4f46-81e1-5bda9a70d1e9 2025-04-14 12:42:24,197 - INFO - Verified VN network id 9 for VN d4ee885e-21b9-4dc8-9fc8-471e316c1fd3 2025-04-14 12:42:24,198 - INFO - Verifications in API Server for VN ctest-left_vn-04111556 passed 2025-04-14 12:42:24,198 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/d4ee885e-21b9-4dc8-9fc8-471e316c1fd3 2025-04-14 12:42:24,209 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/d58b157d-30b9-4f46-81e1-5bda9a70d1e9 2025-04-14 12:42:24,218 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/d58b157d-30b9-4f46-81e1-5bda9a70d1e9 2025-04-14 12:42:24,231 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/b3594839-ec36-4c59-bfd6-3a2d884e88e8 2025-04-14 12:42:24,246 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-93956523', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15343350918371954120', 'uuid-lslong': '11513530642376433619'}, 'enable': 'true', 'created': '2025-04-14T12:42:23', 'last-modified': '2025-04-14T12:42:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.452461'} 2025-04-14 12:42:24,253 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-04-14 12:42:24,253 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-04111556 passed 2025-04-14 12:42:24,253 - DEBUG - ====Verifying policy data for ctest-left_vn-04111556 in API_Server ====== 2025-04-14 12:42:24,253 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:42:24,260 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:42:24,276 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:42:24,367 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/d4ee885e-21b9-4dc8-9fc8-471e316c1fd3 2025-04-14 12:42:24,381 - DEBUG - =>VN ctest-left_vn-04111556 has no policy to be verified 2025-04-14 12:42:24,381 - DEBUG - Verifying the vn in opserver 2025-04-14 12:42:24,381 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556 virtual network link through opserver 10.0.0.48 2025-04-14 12:42:24,381 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-04-14 12:42:24,395 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556?flat'} 2025-04-14 12:42:24,395 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556 is found in opserver 2025-04-14 12:42:24,410 - DEBUG - Do not have enough data to verify VN in agent 2025-04-14 12:42:24,418 - DEBUG - VRF ids for VN ctest-left_vn-04111556: {} 2025-04-14 12:42:24,663 - DEBUG - Response for create_network : {'network': {'id': '35911ab6-2ccc-4e4e-90a7-fbf450821d4d', 'name': 'ctest-right_vn-67500391', 'tenant_id': 'd088b3deae484f5d95b5d69eb2ecec19', 'project_id': 'd088b3deae484f5d95b5d69eb2ecec19', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-93956523', 'ctest-right_vn-67500391'], 'port_security_enabled': True, 'description': ''}} 2025-04-14 12:42:24,868 - DEBUG - Response for create_subnet : {'subnet': {'id': '46d8a3a8-daf7-4a0a-8df7-7babcd853eb0', 'name': '', 'tenant_id': 'd088b3deae484f5d95b5d69eb2ecec19', 'network_id': '35911ab6-2ccc-4e4e-90a7-fbf450821d4d', 'ip_version': 4, 'cidr': '23.168.128.128/26', 'allocation_pools': [{'start': '23.168.128.130', 'end': '23.168.128.190'}], 'gateway_ip': '23.168.128.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '23.168.128.130', 'tags': [], 'project_id': 'd088b3deae484f5d95b5d69eb2ecec19'}} 2025-04-14 12:42:24,891 - INFO - Created VN ctest-right_vn-67500391 2025-04-14 12:42:24,950 - DEBUG - VN ctest-right_vn-67500391 UUID is 35911ab6-2ccc-4e4e-90a7-fbf450821d4d 2025-04-14 12:42:25,067 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:42:25,074 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:42:25,088 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:42:25,171 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/35911ab6-2ccc-4e4e-90a7-fbf450821d4d 2025-04-14 12:42:25,185 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/35911ab6-2ccc-4e4e-90a7-fbf450821d4d 2025-04-14 12:42:25,196 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/84046a8c-1d9b-4968-8ca4-35abc833b31d 2025-04-14 12:42:25,204 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/84046a8c-1d9b-4968-8ca4-35abc833b31d 2025-04-14 12:42:25,215 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/863336c7-017b-4681-a7d5-f6ed565d2c94 2025-04-14 12:42:25,226 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-04-14 12:42:25,226 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/35911ab6-2ccc-4e4e-90a7-fbf450821d4d 2025-04-14 12:42:25,237 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/84046a8c-1d9b-4968-8ca4-35abc833b31d 2025-04-14 12:42:25,254 - INFO - Verified VN network id 10 for VN 35911ab6-2ccc-4e4e-90a7-fbf450821d4d 2025-04-14 12:42:25,254 - INFO - Verifications in API Server for VN ctest-right_vn-67500391 passed 2025-04-14 12:42:25,254 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/35911ab6-2ccc-4e4e-90a7-fbf450821d4d 2025-04-14 12:42:25,265 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/84046a8c-1d9b-4968-8ca4-35abc833b31d 2025-04-14 12:42:25,273 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/84046a8c-1d9b-4968-8ca4-35abc833b31d 2025-04-14 12:42:25,282 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/863336c7-017b-4681-a7d5-f6ed565d2c94 2025-04-14 12:42:25,296 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-93956523', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3859895725371182670', 'uuid-lslong': '10423576889313598797'}, 'enable': 'true', 'created': '2025-04-14T12:42:24', 'last-modified': '2025-04-14T12:42:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.486325'} 2025-04-14 12:42:25,303 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-04-14 12:42:25,303 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-67500391 passed 2025-04-14 12:42:25,303 - DEBUG - ====Verifying policy data for ctest-right_vn-67500391 in API_Server ====== 2025-04-14 12:42:25,303 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:42:25,310 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:42:25,324 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:42:25,407 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/35911ab6-2ccc-4e4e-90a7-fbf450821d4d 2025-04-14 12:42:25,418 - DEBUG - =>VN ctest-right_vn-67500391 has no policy to be verified 2025-04-14 12:42:25,419 - DEBUG - Verifying the vn in opserver 2025-04-14 12:42:25,419 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391 virtual network link through opserver 10.0.0.48 2025-04-14 12:42:25,419 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-04-14 12:42:25,431 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391?flat'} 2025-04-14 12:42:25,431 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391 is found in opserver 2025-04-14 12:42:25,444 - DEBUG - Do not have enough data to verify VN in agent 2025-04-14 12:42:25,453 - DEBUG - VRF ids for VN ctest-right_vn-67500391: {} 2025-04-14 12:42:25,516 - DEBUG - Services list from nova: [, , ] 2025-04-14 12:42:26,565 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3095-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3095-1) 2025-04-14 12:42:27,764 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3095-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3095-1) 2025-04-14 12:42:27,764 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-86529944'] 2025-04-14 12:42:28,170 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-86529944'] created succesfully 2025-04-14 12:42:28,527 - DEBUG - Image by name cirros_in_net not found 2025-04-14 12:42:28,528 - DEBUG - Installing image cirros_in_net 2025-04-14 12:42:28,528 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-04-14 12:42:28,528 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-04-14 12:42:28,528 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-04-14 12:42:28,542 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2025-04-14 12:42:28,662 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2025-04-14 12:42:28,663 - DEBUG - Unzip image 2025-04-14 12:42:28,663 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2025-04-14 12:42:28,813 - DEBUG - Try to create image in user context 2025-04-14 12:42:29,063 - DEBUG - Image has been created in user context 2025-04-14 12:42:29,063 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2025-04-14 12:42:29,081 - DEBUG - Downloaded image has been removed 2025-04-14 12:42:29,096 - DEBUG - Uploaded image status = active 2025-04-14 12:42:30,286 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3095-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3095-1) 2025-04-14 12:42:30,287 - INFO - Waiting for VM ctest-pt_svm0-40496956 to be up.. 2025-04-14 12:42:30,332 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-04-14 12:42:35,435 - DEBUG - VM is in ACTIVE state now 2025-04-14 12:42:35,435 - INFO - VM name : ctest-pt_svm0-40496956 2025-04-14 12:42:35,526 - DEBUG - VM ctest-pt_svm0-40496956 ID is e2e70f0a-24c0-4902-816d-b2eab8d93675 2025-04-14 12:42:35,550 - DEBUG - VM ctest-pt_svm0-40496956 launched on Node cn-jenkins-deploy-platform-ansible-os-3095-1 2025-04-14 12:42:35,835 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/e2e70f0a-24c0-4902-816d-b2eab8d93675 2025-04-14 12:42:35,847 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/1f2dc68c-19bb-4b79-995d-4a3a0518dda1 2025-04-14 12:42:35,860 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/2063f0f2-a0b9-411f-80e5-0ff1cd23316d 2025-04-14 12:42:35,871 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/7c952bb3-4a1a-4920-9174-dd400c6ab64d 2025-04-14 12:42:39,136 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-04-14 12:42:39,136 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-40496956 failed! 2025-04-14 12:42:39,198 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428 is 110.212.222.129 and allocation pool is NOT set 2025-04-14 12:42:43,265 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-04-14 12:42:43,265 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-40496956 failed! 2025-04-14 12:42:43,322 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428 is 110.212.222.129 and allocation pool is NOT set 2025-04-14 12:42:47,390 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-04-14 12:42:47,390 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-40496956 failed! 2025-04-14 12:42:47,458 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428 is 110.212.222.129 and allocation pool is NOT set 2025-04-14 12:42:51,515 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2025-04-14 12:42:51,515 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-40496956 failed! 2025-04-14 12:42:51,574 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428 is 110.212.222.129 and allocation pool is NOT set 2025-04-14 12:42:53,636 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=12.6 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.962 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.962/6.788/12.614/5.826 ms') 2025-04-14 12:42:53,636 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-40496956 passed 2025-04-14 12:42:53,794 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:42:53,794 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40496956, IP 110.212.222.131, Port 22 2025-04-14 12:42:53,860 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-04-14 12:42:53,947 - DEBUG - VM ctest-pt_svm0-40496956 is NOT ready for SSH connections, VM status: ACTIVE 2025-04-14 12:42:58,948 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:42:58,948 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40496956, IP 110.212.222.131, Port 22 2025-04-14 12:42:59,017 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-04-14 12:42:59,110 - DEBUG - VM ctest-pt_svm0-40496956 is NOT ready for SSH connections, VM status: ACTIVE 2025-04-14 12:43:04,110 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:04,110 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40496956, IP 110.212.222.131, Port 22 2025-04-14 12:43:04,166 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-04-14 12:43:04,256 - DEBUG - VM ctest-pt_svm0-40496956 is NOT ready for SSH connections, VM status: ACTIVE 2025-04-14 12:43:09,257 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:09,258 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40496956, IP 110.212.222.131, Port 22 2025-04-14 12:43:09,328 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-04-14 12:43:09,437 - DEBUG - VM ctest-pt_svm0-40496956 is NOT ready for SSH connections, VM status: ACTIVE 2025-04-14 12:43:14,438 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:14,439 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40496956, IP 110.212.222.131, Port 22 2025-04-14 12:43:14,594 - DEBUG - VM ctest-pt_svm0-40496956 is ready for SSH connections 2025-04-14 12:43:14,750 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:14,750 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40496956, IP 110.212.222.131, Port 22 2025-04-14 12:43:14,923 - DEBUG - VM ctest-pt_svm0-40496956 is ready for SSH connections 2025-04-14 12:43:15,082 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:15,082 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40496956, IP 110.212.222.131, Port 22 2025-04-14 12:43:15,234 - DEBUG - VM ctest-pt_svm0-40496956 is ready for SSH connections 2025-04-14 12:43:15,241 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-93956523', 'ctest-si-61757399'] 2025-04-14 12:43:16,186 - INFO - Waiting for VM ctest-left_vm-25804099 to be up.. 2025-04-14 12:43:16,280 - DEBUG - VM is in ACTIVE state now 2025-04-14 12:43:16,280 - INFO - VM name : ctest-left_vm-25804099 2025-04-14 12:43:16,400 - DEBUG - VM ctest-left_vm-25804099 ID is 81535130-d851-4221-a685-c76ea30babef 2025-04-14 12:43:16,400 - DEBUG - VM ctest-left_vm-25804099 launched on Node cn-jenkins-deploy-platform-ansible-os-3095-1 2025-04-14 12:43:16,500 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/81535130-d851-4221-a685-c76ea30babef 2025-04-14 12:43:16,512 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/6b324803-6161-4c78-87c1-f93c3840f20b 2025-04-14 12:43:17,769 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.30 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.438 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.438/1.870/3.303/1.432 ms') 2025-04-14 12:43:17,770 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-25804099 passed 2025-04-14 12:43:17,926 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:17,926 - DEBUG - Waiting to SSH to VM ctest-left_vm-25804099, IP 70.134.163.195, Port 22 2025-04-14 12:43:18,086 - DEBUG - VM ctest-left_vm-25804099 is ready for SSH connections 2025-04-14 12:43:18,086 - INFO - Waiting for VM ctest-right_vm-80193605 to be up.. 2025-04-14 12:43:18,167 - DEBUG - VM is in ACTIVE state now 2025-04-14 12:43:18,168 - INFO - VM name : ctest-right_vm-80193605 2025-04-14 12:43:18,254 - DEBUG - VM ctest-right_vm-80193605 ID is 8e6f339b-a0af-448b-a6c8-26f84f285f3c 2025-04-14 12:43:18,254 - DEBUG - VM ctest-right_vm-80193605 launched on Node cn-jenkins-deploy-platform-ansible-os-3095-1 2025-04-14 12:43:18,332 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/8e6f339b-a0af-448b-a6c8-26f84f285f3c 2025-04-14 12:43:18,343 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/3e8a38e7-e507-4af2-ab1e-0defa0a8cf9f 2025-04-14 12:43:19,588 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.25 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.462 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.462/2.357/4.252/1.895 ms') 2025-04-14 12:43:19,589 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-right_vm-80193605 passed 2025-04-14 12:43:19,742 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:19,742 - DEBUG - Waiting to SSH to VM ctest-right_vm-80193605, IP 23.168.128.131, Port 22 2025-04-14 12:43:19,906 - DEBUG - VM ctest-right_vm-80193605 is ready for SSH connections 2025-04-14 12:43:19,912 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-93956523:ctest-si-61757399'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-04-14 12:43:20,350 - INFO - Attaching policy ctest-policy-68686472 to vn ctest-left_vn-04111556 2025-04-14 12:43:20,914 - INFO - Attaching policy ctest-policy-68686472 to vn ctest-right_vn-67500391 2025-04-14 12:43:21,390 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-86529944'] created succesfully 2025-04-14 12:43:21,634 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-93956523', 'ctest-si-61757399'] created succesfully 2025-04-14 12:43:21,634 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:43:21,641 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:43:21,656 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:43:21,738 - DEBUG - Requesting: http://10.0.0.48:8082/service-instance/f2022e7d-1b5a-47b1-90d6-2e03a6baf00c 2025-04-14 12:43:21,749 - DEBUG - SI 'ctest-si-61757399' has service template ref to ctest-service_template_1-86529944 2025-04-14 12:43:21,749 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:43:21,755 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:43:21,773 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:43:21,857 - DEBUG - Requesting: http://10.0.0.48:8082/service-instance/f2022e7d-1b5a-47b1-90d6-2e03a6baf00c 2025-04-14 12:43:21,867 - DEBUG - Requesting: http://10.0.0.48:8082/port-tuple/e2135a52-799e-4211-bbdb-210130413ba5 2025-04-14 12:43:21,875 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/1f2dc68c-19bb-4b79-995d-4a3a0518dda1 2025-04-14 12:43:21,887 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/2063f0f2-a0b9-411f-80e5-0ff1cd23316d 2025-04-14 12:43:21,902 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/7c952bb3-4a1a-4920-9174-dd400c6ab64d 2025-04-14 12:43:22,181 - DEBUG - VM is in ACTIVE state now 2025-04-14 12:43:22,642 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/e2e70f0a-24c0-4902-816d-b2eab8d93675 2025-04-14 12:43:22,653 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/1f2dc68c-19bb-4b79-995d-4a3a0518dda1 2025-04-14 12:43:22,670 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/2063f0f2-a0b9-411f-80e5-0ff1cd23316d 2025-04-14 12:43:22,689 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/7c952bb3-4a1a-4920-9174-dd400c6ab64d 2025-04-14 12:43:22,709 - DEBUG - Requesting: http://10.0.0.48:8082/instance-ip/26566f81-b1d7-4b1c-879f-2a8292e0ae85 2025-04-14 12:43:22,724 - DEBUG - Requesting: http://10.0.0.48:8082/instance-ip/2d0040cd-22f4-4d8b-a542-f623ec560da5 2025-04-14 12:43:22,734 - DEBUG - Requesting: http://10.0.0.48:8082/instance-ip/cd32e559-c837-4ca5-af43-03680ff50837 2025-04-14 12:43:22,744 - DEBUG - Requesting: http://10.0.0.48:8082/instance-ip/07911ce7-efc9-4351-9979-8a2384f2b03c 2025-04-14 12:43:22,757 - DEBUG - Requesting: http://10.0.0.48:8082/instance-ip/21cbf36a-4be6-4404-873c-34fa9ecc2d3d 2025-04-14 12:43:22,767 - DEBUG - Requesting: http://10.0.0.48:8082/instance-ip/478f3ac6-cee4-402c-912f-3f115f0684d8 2025-04-14 12:43:22,779 - DEBUG - Requesting: http://10.0.0.48:8082/instance-ip/55a65268-af58-4c70-b606-6e796ec588c7 2025-04-14 12:43:22,789 - DEBUG - Requesting: http://10.0.0.48:8082/instance-ip/583a8572-1a36-4655-9e4f-fb3d043f3597 2025-04-14 12:43:22,800 - DEBUG - Requesting: http://10.0.0.48:8082/instance-ip/b4791956-72bf-4da0-96f9-b054583109f3 2025-04-14 12:43:23,264 - DEBUG - VM is in ACTIVE state now 2025-04-14 12:43:23,264 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/e2e70f0a-24c0-4902-816d-b2eab8d93675 2025-04-14 12:43:23,274 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/1f2dc68c-19bb-4b79-995d-4a3a0518dda1 2025-04-14 12:43:23,286 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/2063f0f2-a0b9-411f-80e5-0ff1cd23316d 2025-04-14 12:43:23,298 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/7c952bb3-4a1a-4920-9174-dd400c6ab64d 2025-04-14 12:43:24,559 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=1.89 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.696 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.696/1.292/1.888/0.596 ms') 2025-04-14 12:43:24,559 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-40496956 passed 2025-04-14 12:43:24,599 - DEBUG - VM ctest-pt_svm0-40496956 Tap interface: {'index': '6', 'name': 'tap2063f0f2-a0', 'uuid': '2063f0f2-a0b9-411f-80e5-0ff1cd23316d', 'vrf_name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556:ctest-left_vn-04111556', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556', 'vm_uuid': 'e2e70f0a-24c0-4902-816d-b2eab8d93675', 'vm_name': 'ctest-pt_svm0-40496956', 'ip_addr': '70.134.163.196', 'mac_addr': '02:20:63:f0:f2:a0', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-93956523:2063f0f2-a0b9-411f-80e5-0ff1cd23316d', 'sg_uuid_list': ['58278d55-20b0-48a4-8a67-1bad752a26d9'], 'static_route_list': None, 'vm_project_uuid': 'd088b3de-ae48-4f5d-95b5-d69eb2ecec19', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '1f2dc68c-19bb-4b79-995d-4a3a0518dda1', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-04-14 12:43:24,599 - DEBUG - Agent 10.0.0.48 vrf name: default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556:ctest-left_vn-04111556 2025-04-14 12:43:24,604 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556:ctest-left_vn-04111556', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556', 'table_label': '-1', 'vxlan_id': '9', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.17:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-04-14 12:43:24,775 - DEBUG - VM ctest-pt_svm0-40496956 : Tap interface tap2063f0f2-a0 is set to Active 2025-04-14 12:43:24,775 - DEBUG - Tap interface tap2063f0f2-a0 detail : {'index': '6', 'name': 'tap2063f0f2-a0', 'uuid': '2063f0f2-a0b9-411f-80e5-0ff1cd23316d', 'vrf_name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556:ctest-left_vn-04111556', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556', 'vm_uuid': 'e2e70f0a-24c0-4902-816d-b2eab8d93675', 'vm_name': 'ctest-pt_svm0-40496956', 'ip_addr': '70.134.163.196', 'mac_addr': '02:20:63:f0:f2:a0', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-93956523:2063f0f2-a0b9-411f-80e5-0ff1cd23316d', 'sg_uuid_list': ['58278d55-20b0-48a4-8a67-1bad752a26d9'], 'static_route_list': None, 'vm_project_uuid': 'd088b3de-ae48-4f5d-95b5-d69eb2ecec19', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '1f2dc68c-19bb-4b79-995d-4a3a0518dda1', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-04-14 12:43:24,978 - DEBUG - Starting Layer 2 verification in Agent 2025-04-14 12:43:24,994 - DEBUG - Layer 2 path is seen for VM MAC 02:20:63:f0:f2:a0 in agent 10.0.0.48 2025-04-14 12:43:24,994 - DEBUG - Active layer 2 route in agent is present for VMI tap2063f0f2-a0 2025-04-14 12:43:24,994 - DEBUG - L2 label(48) matches bw route table and interface table 2025-04-14 12:43:25,001 - DEBUG - VN default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556 is found in Agent of node 10.0.0.48 2025-04-14 12:43:25,232 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556 is consistent in agent 10.0.0.48 2025-04-14 12:43:25,233 - DEBUG - Route for VM IP ['70.134.163.196'] is consistent in agent 10.0.0.48 2025-04-14 12:43:25,233 - DEBUG - VN default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556 verification for VM ctest-pt_svm0-40496956 in Agent 10.0.0.48 passed 2025-04-14 12:43:25,430 - DEBUG - Starting all layer 2 verification in agent 10.0.0.48 2025-04-14 12:43:25,442 - DEBUG - Route for VM MAC 02:20:63:f0:f2:a0 is consistent in agent 10.0.0.48 2025-04-14 12:43:25,466 - DEBUG - VM ctest-pt_svm0-40496956 Tap interface: {'index': '5', 'name': 'tap7c952bb3-4a', 'uuid': '7c952bb3-4a1a-4920-9174-dd400c6ab64d', 'vrf_name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428:ctest-mgmt_vn-60351428', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428', 'vm_uuid': 'e2e70f0a-24c0-4902-816d-b2eab8d93675', 'vm_name': 'ctest-pt_svm0-40496956', 'ip_addr': '110.212.222.131', 'mac_addr': '02:7c:95:2b:b3:4a', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-93956523:7c952bb3-4a1a-4920-9174-dd400c6ab64d', 'sg_uuid_list': ['58278d55-20b0-48a4-8a67-1bad752a26d9'], 'static_route_list': None, 'vm_project_uuid': 'd088b3de-ae48-4f5d-95b5-d69eb2ecec19', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-04-14 12:43:25,466 - DEBUG - Agent 10.0.0.48 vrf name: default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428:ctest-mgmt_vn-60351428 2025-04-14 12:43:25,471 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428:ctest-mgmt_vn-60351428', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428', 'table_label': '-1', 'vxlan_id': '8', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.17:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-04-14 12:43:25,647 - DEBUG - VM ctest-pt_svm0-40496956 : Tap interface tap7c952bb3-4a is set to Active 2025-04-14 12:43:25,647 - DEBUG - Tap interface tap7c952bb3-4a detail : {'index': '5', 'name': 'tap7c952bb3-4a', 'uuid': '7c952bb3-4a1a-4920-9174-dd400c6ab64d', 'vrf_name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428:ctest-mgmt_vn-60351428', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428', 'vm_uuid': 'e2e70f0a-24c0-4902-816d-b2eab8d93675', 'vm_name': 'ctest-pt_svm0-40496956', 'ip_addr': '110.212.222.131', 'mac_addr': '02:7c:95:2b:b3:4a', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-93956523:7c952bb3-4a1a-4920-9174-dd400c6ab64d', 'sg_uuid_list': ['58278d55-20b0-48a4-8a67-1bad752a26d9'], 'static_route_list': None, 'vm_project_uuid': 'd088b3de-ae48-4f5d-95b5-d69eb2ecec19', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-04-14 12:43:25,846 - DEBUG - Starting Layer 2 verification in Agent 2025-04-14 12:43:25,858 - DEBUG - Layer 2 path is seen for VM MAC 02:7c:95:2b:b3:4a in agent 10.0.0.48 2025-04-14 12:43:25,858 - DEBUG - Active layer 2 route in agent is present for VMI tap7c952bb3-4a 2025-04-14 12:43:25,858 - DEBUG - L2 label(43) matches bw route table and interface table 2025-04-14 12:43:25,864 - DEBUG - VN default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428 is found in Agent of node 10.0.0.48 2025-04-14 12:43:26,081 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428 is consistent in agent 10.0.0.48 2025-04-14 12:43:26,081 - DEBUG - Route for VM IP ['110.212.222.131'] is consistent in agent 10.0.0.48 2025-04-14 12:43:26,082 - DEBUG - VN default-domain:ctest-TestSvcRegr-93956523:ctest-mgmt_vn-60351428 verification for VM ctest-pt_svm0-40496956 in Agent 10.0.0.48 passed 2025-04-14 12:43:26,278 - DEBUG - Starting all layer 2 verification in agent 10.0.0.48 2025-04-14 12:43:26,291 - DEBUG - Route for VM MAC 02:7c:95:2b:b3:4a is consistent in agent 10.0.0.48 2025-04-14 12:43:26,315 - DEBUG - VM ctest-pt_svm0-40496956 Tap interface: {'index': '7', 'name': 'tap1f2dc68c-19', 'uuid': '1f2dc68c-19bb-4b79-995d-4a3a0518dda1', 'vrf_name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391:ctest-right_vn-67500391', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391', 'vm_uuid': 'e2e70f0a-24c0-4902-816d-b2eab8d93675', 'vm_name': 'ctest-pt_svm0-40496956', 'ip_addr': '23.168.128.132', 'mac_addr': '02:1f:2d:c6:8c:19', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '30', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-93956523:1f2dc68c-19bb-4b79-995d-4a3a0518dda1', 'sg_uuid_list': ['58278d55-20b0-48a4-8a67-1bad752a26d9'], 'static_route_list': None, 'vm_project_uuid': 'd088b3de-ae48-4f5d-95b5-d69eb2ecec19', 'admin_state': 'Enabled', 'flow_key_idx': '26', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '2063f0f2-a0b9-411f-80e5-0ff1cd23316d', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-04-14 12:43:26,315 - DEBUG - Agent 10.0.0.48 vrf name: default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391:ctest-right_vn-67500391 2025-04-14 12:43:26,321 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391:ctest-right_vn-67500391', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391', 'table_label': '-1', 'vxlan_id': '10', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.17:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-04-14 12:43:26,496 - DEBUG - VM ctest-pt_svm0-40496956 : Tap interface tap1f2dc68c-19 is set to Active 2025-04-14 12:43:26,496 - DEBUG - Tap interface tap1f2dc68c-19 detail : {'index': '7', 'name': 'tap1f2dc68c-19', 'uuid': '1f2dc68c-19bb-4b79-995d-4a3a0518dda1', 'vrf_name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391:ctest-right_vn-67500391', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391', 'vm_uuid': 'e2e70f0a-24c0-4902-816d-b2eab8d93675', 'vm_name': 'ctest-pt_svm0-40496956', 'ip_addr': '23.168.128.132', 'mac_addr': '02:1f:2d:c6:8c:19', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '30', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-93956523:1f2dc68c-19bb-4b79-995d-4a3a0518dda1', 'sg_uuid_list': ['58278d55-20b0-48a4-8a67-1bad752a26d9'], 'static_route_list': None, 'vm_project_uuid': 'd088b3de-ae48-4f5d-95b5-d69eb2ecec19', 'admin_state': 'Enabled', 'flow_key_idx': '26', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '2063f0f2-a0b9-411f-80e5-0ff1cd23316d', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-04-14 12:43:26,702 - DEBUG - Starting Layer 2 verification in Agent 2025-04-14 12:43:26,714 - DEBUG - Layer 2 path is seen for VM MAC 02:1f:2d:c6:8c:19 in agent 10.0.0.48 2025-04-14 12:43:26,714 - DEBUG - Active layer 2 route in agent is present for VMI tap1f2dc68c-19 2025-04-14 12:43:26,714 - DEBUG - L2 label(53) matches bw route table and interface table 2025-04-14 12:43:26,720 - DEBUG - VN default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391 is found in Agent of node 10.0.0.48 2025-04-14 12:43:26,937 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391 is consistent in agent 10.0.0.48 2025-04-14 12:43:26,937 - DEBUG - Route for VM IP ['23.168.128.132'] is consistent in agent 10.0.0.48 2025-04-14 12:43:26,937 - DEBUG - VN default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391 verification for VM ctest-pt_svm0-40496956 in Agent 10.0.0.48 passed 2025-04-14 12:43:27,134 - DEBUG - Starting all layer 2 verification in agent 10.0.0.48 2025-04-14 12:43:27,147 - DEBUG - Route for VM MAC 02:1f:2d:c6:8c:19 is consistent in agent 10.0.0.48 2025-04-14 12:43:27,147 - INFO - VM ctest-pt_svm0-40496956 verifications in Compute nodes passed 2025-04-14 12:43:27,148 - DEBUG - The SVMs in the SI are : [] 2025-04-14 12:43:27,148 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/e2e70f0a-24c0-4902-816d-b2eab8d93675 2025-04-14 12:43:27,157 - DEBUG - Service VM for SI 'ctest-si-61757399' is launched 2025-04-14 12:43:27,157 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:43:27,164 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:43:27,178 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:43:27,257 - DEBUG - Requesting: http://10.0.0.48:8082/service-instance/f2022e7d-1b5a-47b1-90d6-2e03a6baf00c 2025-04-14 12:43:27,268 - DEBUG - SI ctest-si-61757399 has Port Tuple: ['ctest-port_tuple-90551982'] 2025-04-14 12:43:27,374 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-93956523:ctest-left_vn-04111556 2025-04-14 12:43:27,522 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-93956523:ctest-right_vn-67500391 2025-04-14 12:43:27,681 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:27,689 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:27,690 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:27,696 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:27,696 - INFO - Route to 23.168.128.131 seen in VRF:5 on cn-jenkins-deploy-platform-ansible-os-3095-1, and SI ctest-si-61757399 is seen as the NH 2025-04-14 12:43:27,857 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:27,865 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:27,866 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:27,872 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:27,872 - INFO - Route to 70.134.163.195 seen in VRF:6 on cn-jenkins-deploy-platform-ansible-os-3095-1, and SI ctest-si-61757399 is seen as the NH 2025-04-14 12:43:27,872 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:27,872 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-14 12:43:27,872 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 23.168.128.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-04-14 12:43:27,873 - DEBUG - ping -s 56 -c 3 -W 1 23.168.128.131 2025-04-14 12:43:31,852 - DEBUG - PING 23.168.128.131 (23.168.128.131): 56 data bytes 64 bytes from 23.168.128.131: seq=0 ttl=61 time=6.197 ms 64 bytes from 23.168.128.131: seq=1 ttl=61 time=2.190 ms 64 bytes from 23.168.128.131: seq=2 ttl=61 time=1.984 ms --- 23.168.128.131 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.984/3.457/6.197 ms 2025-04-14 12:43:31,852 - INFO - Ping to IP 23.168.128.131 from VM ctest-left_vm-25804099 passed 2025-04-14 12:43:31,852 - INFO - Dettaching policy ctest-policy-68686472 from vn ctest-right_vn-67500391 2025-04-14 12:43:32,070 - INFO - Dettaching policy ctest-policy-68686472 from vn ctest-left_vn-04111556 2025-04-14 12:43:32,371 - INFO - Deleted policy ctest-policy-68686472 2025-04-14 12:43:32,371 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-93956523', 'ctest-si-61757399'] 2025-04-14 12:43:32,478 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-93956523', 'ctest-si-61757399'] 2025-04-14 12:43:32,478 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:43:32,488 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:43:32,513 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:43:32,597 - DEBUG - Service instance ctest-si-61757399 removed from api server 2025-04-14 12:43:32,597 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/e2e70f0a-24c0-4902-816d-b2eab8d93675 2025-04-14 12:43:32,607 - DEBUG - All Service VMs unlinked from SI ctest-si-61757399 2025-04-14 12:43:32,616 - DEBUG - 0 svc intances found in all projects. They are [] 2025-04-14 12:43:32,616 - DEBUG - 0 svc intances found in current project. They are [] 2025-04-14 12:43:32,670 - DEBUG - 0 svc intances found in all projects. They are [] 2025-04-14 12:43:32,670 - DEBUG - 0 svc intances found in current project. They are [] 2025-04-14 12:43:32,670 - INFO - Deleting VM ctest-pt_svm0-40496956 2025-04-14 12:43:32,753 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-86529944'] 2025-04-14 12:43:32,855 - INFO - Service template: ['default-domain', 'ctest-service_template_1-86529944'] deleted successfully. 2025-04-14 12:43:32,856 - INFO - Deleting VM ctest-right_vm-80193605 2025-04-14 12:43:32,943 - INFO - Deleting VM ctest-left_vm-25804099 2025-04-14 12:43:33,035 - INFO - Deleting VN ctest-right_vn-67500391 2025-04-14 12:43:33,088 - DEBUG - VN 35911ab6-2ccc-4e4e-90a7-fbf450821d4d still in use: Unable to complete operation on network 35911ab6-2ccc-4e4e-90a7-fbf450821d4d. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-0cf64efa-4727-4bd7-8901-c8b18a15b45f'] 2025-04-14 12:43:33,088 - WARNING - Deleting VN ctest-right_vn-67500391 failed..Will retry 2025-04-14 12:43:35,213 - DEBUG - Response for deleting network () 2025-04-14 12:43:35,213 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/84046a8c-1d9b-4968-8ca4-35abc833b31d 2025-04-14 12:43:35,220 - DEBUG - Response Code: 404 2025-04-14 12:43:35,220 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:43:35,226 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:43:35,282 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:43:35,368 - INFO - Validated that VN ctest-right_vn-67500391 is not found in API Server 2025-04-14 12:43:35,379 - DEBUG - VN ctest-right_vn-67500391 is not present in Agent 10.0.0.48 2025-04-14 12:43:35,380 - INFO - Validated that VN ctest-right_vn-67500391 is not in any agent 2025-04-14 12:43:35,396 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-67500391 info 2025-04-14 12:43:35,396 - INFO - Deleting VN ctest-left_vn-04111556 2025-04-14 12:43:35,508 - DEBUG - Response for deleting network () 2025-04-14 12:43:35,509 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/d58b157d-30b9-4f46-81e1-5bda9a70d1e9 2025-04-14 12:43:35,517 - DEBUG - Response Code: 404 2025-04-14 12:43:35,517 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:43:35,525 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:43:35,580 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:43:35,658 - INFO - Validated that VN ctest-left_vn-04111556 is not found in API Server 2025-04-14 12:43:35,669 - DEBUG - VN ctest-left_vn-04111556 is not present in Agent 10.0.0.48 2025-04-14 12:43:35,669 - INFO - Validated that VN ctest-left_vn-04111556 is not in any agent 2025-04-14 12:43:35,686 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-04111556 info 2025-04-14 12:43:35,686 - INFO - Deleting VN ctest-mgmt_vn-60351428 2025-04-14 12:43:35,823 - DEBUG - Response for deleting network () 2025-04-14 12:43:35,823 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/56b05619-f4b3-4e58-81db-f0ac70030322 2025-04-14 12:43:35,836 - DEBUG - Response Code: 404 2025-04-14 12:43:35,836 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-04-14 12:43:35,844 - DEBUG - Requesting: http://10.0.0.48:8082/domain/159f0099-3da5-4f56-af64-0edeb99619ce 2025-04-14 12:43:35,900 - DEBUG - Requesting: http://10.0.0.48:8082/project/d088b3de-ae48-4f5d-95b5-d69eb2ecec19 2025-04-14 12:43:35,971 - INFO - Validated that VN ctest-mgmt_vn-60351428 is not found in API Server 2025-04-14 12:43:35,983 - DEBUG - VN ctest-mgmt_vn-60351428 is not present in Agent 10.0.0.48 2025-04-14 12:43:35,983 - INFO - Validated that VN ctest-mgmt_vn-60351428 is not in any agent 2025-04-14 12:43:35,998 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-60351428 info 2025-04-14 12:43:36,256 - DEBUG - No XMPP flaps were noticed during the test 2025-04-14 12:43:36,256 - INFO -
2025-04-14 12:43:36,256 - INFO - END TEST : test_svc_in_network_datapath : PASSED[0:01:15]
2025-04-14 12:43:36,257 - INFO - -------------------------------------------------------------------------------- 2025-04-14 12:43:36,966 - INFO - Deleted project: ctest-TestSvcRegr-93956523, ID : d088b3de-ae48-4f5d-95b5-d69eb2ecec19