2024-08-24 02:30:41,428 - INFO - Domain Default found not creating 2024-08-24 02:30:41,583 - INFO - Project ctest-TestSvcRegr-29127878 not found, creating it 2024-08-24 02:30:45,189 - INFO - Created Project:ctest-TestSvcRegr-29127878, ID : a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:30:46,637 - INFO - ================================================================================ 2024-08-24 02:30:46,637 - INFO - STARTING TEST : test_svc_in_network_datapath 2024-08-24 02:30:46,896 - DEBUG - Nothing to compare xmpp stats {'10.0.0.52': {'10.20.0.6': '0'}} with 2024-08-24 02:30:46,896 - INFO - Initial checks done. Running the testcase now 2024-08-24 02:30:46,896 - INFO - 2024-08-24 02:30:47,427 - DEBUG - Response for create_network : {'network': {'id': 'f3492a05-3ff6-4812-9569-4ba39acd3835', 'name': 'ctest-mgmt_vn-38885873', 'tenant_id': 'a055c7bf2f3748adb01b9c2d53f69c5b', 'project_id': 'a055c7bf2f3748adb01b9c2d53f69c5b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-29127878', 'ctest-mgmt_vn-38885873'], 'port_security_enabled': True, 'description': ''}} 2024-08-24 02:30:47,725 - DEBUG - Response for create_subnet : {'subnet': {'id': '3a97e2c2-0663-461b-80f6-c66a10cc06e2', 'name': '', 'tenant_id': 'a055c7bf2f3748adb01b9c2d53f69c5b', 'network_id': 'f3492a05-3ff6-4812-9569-4ba39acd3835', 'ip_version': 4, 'cidr': '62.225.210.192/26', 'allocation_pools': [{'start': '62.225.210.194', 'end': '62.225.210.254'}], 'gateway_ip': '62.225.210.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '62.225.210.194', 'tags': [], 'project_id': 'a055c7bf2f3748adb01b9c2d53f69c5b'}} 2024-08-24 02:30:47,744 - INFO - Created VN ctest-mgmt_vn-38885873 2024-08-24 02:30:47,797 - DEBUG - VN ctest-mgmt_vn-38885873 UUID is f3492a05-3ff6-4812-9569-4ba39acd3835 2024-08-24 02:30:47,905 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:30:48,196 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:30:48,228 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:30:48,241 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:30:48,309 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/f3492a05-3ff6-4812-9569-4ba39acd3835 2024-08-24 02:30:48,318 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/f3492a05-3ff6-4812-9569-4ba39acd3835 2024-08-24 02:30:48,325 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/26c26ecf-3354-4626-a533-31ed5a36c774 2024-08-24 02:30:48,331 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/26c26ecf-3354-4626-a533-31ed5a36c774 2024-08-24 02:30:48,337 - DEBUG - Requesting: http://10.0.0.52:8082/route-target/ee9d86d9-783c-4a96-b2d1-a9d4a7842535 2024-08-24 02:30:48,342 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-08-24 02:30:48,342 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/f3492a05-3ff6-4812-9569-4ba39acd3835 2024-08-24 02:30:48,349 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/26c26ecf-3354-4626-a533-31ed5a36c774 2024-08-24 02:30:48,359 - INFO - Verified VN network id 7 for VN f3492a05-3ff6-4812-9569-4ba39acd3835 2024-08-24 02:30:48,360 - INFO - Verifications in API Server for VN ctest-mgmt_vn-38885873 passed 2024-08-24 02:30:48,360 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/f3492a05-3ff6-4812-9569-4ba39acd3835 2024-08-24 02:30:48,366 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/26c26ecf-3354-4626-a533-31ed5a36c774 2024-08-24 02:30:48,372 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/26c26ecf-3354-4626-a533-31ed5a36c774 2024-08-24 02:30:48,379 - DEBUG - Requesting: http://10.0.0.52:8082/route-target/ee9d86d9-783c-4a96-b2d1-a9d4a7842535 2024-08-24 02:30:48,391 - DEBUG - Control-node 10.0.0.52 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-29127878', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17530589226552674322', 'uuid-lslong': '10766219550254774325'}, 'enable': 'true', 'created': '2024-08-24T02:30:47', 'last-modified': '2024-08-24T02:30:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.803965'} 2024-08-24 02:30:48,397 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-08-24 02:30:48,397 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-38885873 passed 2024-08-24 02:30:48,398 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-38885873 in API_Server ====== 2024-08-24 02:30:48,398 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:30:48,403 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:30:48,416 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:30:48,485 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/f3492a05-3ff6-4812-9569-4ba39acd3835 2024-08-24 02:30:48,492 - DEBUG - =>VN ctest-mgmt_vn-38885873 has no policy to be verified 2024-08-24 02:30:48,492 - DEBUG - Verifying the vn in opserver 2024-08-24 02:30:48,492 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873 virtual network link through opserver 10.0.0.52 2024-08-24 02:30:48,492 - DEBUG - Requesting: http://10.0.0.52:8081/analytics/uves/virtual-networks 2024-08-24 02:30:48,786 - DEBUG - Requesting: http://10.0.0.52:8081/analytics/uves/virtual-networks 2024-08-24 02:30:48,845 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873', 'href': 'http://10.0.0.52:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873?flat'} 2024-08-24 02:30:48,846 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873 is found in opserver 2024-08-24 02:30:48,857 - DEBUG - Do not have enough data to verify VN in agent 2024-08-24 02:30:48,862 - DEBUG - VRF ids for VN ctest-mgmt_vn-38885873: {} 2024-08-24 02:30:49,042 - DEBUG - Response for create_network : {'network': {'id': '906ca33f-ea6d-4f55-a9d0-a20571100a44', 'name': 'ctest-left_vn-90926401', 'tenant_id': 'a055c7bf2f3748adb01b9c2d53f69c5b', 'project_id': 'a055c7bf2f3748adb01b9c2d53f69c5b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-29127878', 'ctest-left_vn-90926401'], 'port_security_enabled': True, 'description': ''}} 2024-08-24 02:30:49,229 - DEBUG - Response for create_subnet : {'subnet': {'id': '967bef4e-8461-4839-a8db-08d2e533bb08', 'name': '', 'tenant_id': 'a055c7bf2f3748adb01b9c2d53f69c5b', 'network_id': '906ca33f-ea6d-4f55-a9d0-a20571100a44', 'ip_version': 4, 'cidr': '211.124.17.128/26', 'allocation_pools': [{'start': '211.124.17.130', 'end': '211.124.17.190'}], 'gateway_ip': '211.124.17.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '211.124.17.130', 'tags': [], 'project_id': 'a055c7bf2f3748adb01b9c2d53f69c5b'}} 2024-08-24 02:30:49,247 - INFO - Created VN ctest-left_vn-90926401 2024-08-24 02:30:49,297 - DEBUG - VN ctest-left_vn-90926401 UUID is 906ca33f-ea6d-4f55-a9d0-a20571100a44 2024-08-24 02:30:49,403 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:30:49,409 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:30:49,421 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:30:49,489 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/906ca33f-ea6d-4f55-a9d0-a20571100a44 2024-08-24 02:30:49,501 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/906ca33f-ea6d-4f55-a9d0-a20571100a44 2024-08-24 02:30:49,509 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/66719a2e-6fd4-4752-b0c1-8051a3e15f46 2024-08-24 02:30:49,516 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/66719a2e-6fd4-4752-b0c1-8051a3e15f46 2024-08-24 02:30:49,523 - DEBUG - Requesting: http://10.0.0.52:8082/route-target/a6bdc6e7-f8e7-425c-ae10-abdd64705d6e 2024-08-24 02:30:49,529 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-08-24 02:30:49,530 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/906ca33f-ea6d-4f55-a9d0-a20571100a44 2024-08-24 02:30:49,537 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/66719a2e-6fd4-4752-b0c1-8051a3e15f46 2024-08-24 02:30:49,549 - INFO - Verified VN network id 8 for VN 906ca33f-ea6d-4f55-a9d0-a20571100a44 2024-08-24 02:30:49,549 - INFO - Verifications in API Server for VN ctest-left_vn-90926401 passed 2024-08-24 02:30:49,549 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/906ca33f-ea6d-4f55-a9d0-a20571100a44 2024-08-24 02:30:49,556 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/66719a2e-6fd4-4752-b0c1-8051a3e15f46 2024-08-24 02:30:49,563 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/66719a2e-6fd4-4752-b0c1-8051a3e15f46 2024-08-24 02:30:49,569 - DEBUG - Requesting: http://10.0.0.52:8082/route-target/a6bdc6e7-f8e7-425c-ae10-abdd64705d6e 2024-08-24 02:30:49,581 - DEBUG - Control-node 10.0.0.52 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-29127878', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10406872333857673045', 'uuid-lslong': '12236458331821050436'}, 'enable': 'true', 'created': '2024-08-24T02:30:49', 'last-modified': '2024-08-24T02:30:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.382749'} 2024-08-24 02:30:49,587 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-08-24 02:30:49,587 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-90926401 passed 2024-08-24 02:30:49,587 - DEBUG - ====Verifying policy data for ctest-left_vn-90926401 in API_Server ====== 2024-08-24 02:30:49,587 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:30:49,592 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:30:49,603 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:30:49,671 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/906ca33f-ea6d-4f55-a9d0-a20571100a44 2024-08-24 02:30:49,679 - DEBUG - =>VN ctest-left_vn-90926401 has no policy to be verified 2024-08-24 02:30:49,679 - DEBUG - Verifying the vn in opserver 2024-08-24 02:30:49,679 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401 virtual network link through opserver 10.0.0.52 2024-08-24 02:30:49,679 - DEBUG - Requesting: http://10.0.0.52:8081/analytics/uves/virtual-networks 2024-08-24 02:30:49,689 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401', 'href': 'http://10.0.0.52:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401?flat'} 2024-08-24 02:30:49,689 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401 is found in opserver 2024-08-24 02:30:49,700 - DEBUG - Do not have enough data to verify VN in agent 2024-08-24 02:30:49,705 - DEBUG - VRF ids for VN ctest-left_vn-90926401: {} 2024-08-24 02:30:49,884 - DEBUG - Response for create_network : {'network': {'id': '94928c52-5764-4a81-a810-f242285fba58', 'name': 'ctest-right_vn-22106394', 'tenant_id': 'a055c7bf2f3748adb01b9c2d53f69c5b', 'project_id': 'a055c7bf2f3748adb01b9c2d53f69c5b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-29127878', 'ctest-right_vn-22106394'], 'port_security_enabled': True, 'description': ''}} 2024-08-24 02:30:50,085 - DEBUG - Response for create_subnet : {'subnet': {'id': '1376cdef-a856-4c1c-b1b4-5d4fe08baa5c', 'name': '', 'tenant_id': 'a055c7bf2f3748adb01b9c2d53f69c5b', 'network_id': '94928c52-5764-4a81-a810-f242285fba58', 'ip_version': 4, 'cidr': '167.91.7.128/26', 'allocation_pools': [{'start': '167.91.7.130', 'end': '167.91.7.190'}], 'gateway_ip': '167.91.7.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '167.91.7.130', 'tags': [], 'project_id': 'a055c7bf2f3748adb01b9c2d53f69c5b'}} 2024-08-24 02:30:50,103 - INFO - Created VN ctest-right_vn-22106394 2024-08-24 02:30:50,153 - DEBUG - VN ctest-right_vn-22106394 UUID is 94928c52-5764-4a81-a810-f242285fba58 2024-08-24 02:30:50,259 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:30:50,264 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:30:50,276 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:30:50,344 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/94928c52-5764-4a81-a810-f242285fba58 2024-08-24 02:30:50,353 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/94928c52-5764-4a81-a810-f242285fba58 2024-08-24 02:30:50,361 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/38e50f85-6c97-4616-846c-bf5bc816ec49 2024-08-24 02:30:50,368 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/38e50f85-6c97-4616-846c-bf5bc816ec49 2024-08-24 02:30:50,374 - DEBUG - Requesting: http://10.0.0.52:8082/route-target/dadd28be-2809-489d-80b6-5f29b8944b23 2024-08-24 02:30:50,381 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-08-24 02:30:50,382 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/94928c52-5764-4a81-a810-f242285fba58 2024-08-24 02:30:50,390 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/38e50f85-6c97-4616-846c-bf5bc816ec49 2024-08-24 02:30:50,402 - INFO - Verified VN network id 9 for VN 94928c52-5764-4a81-a810-f242285fba58 2024-08-24 02:30:50,402 - INFO - Verifications in API Server for VN ctest-right_vn-22106394 passed 2024-08-24 02:30:50,402 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/94928c52-5764-4a81-a810-f242285fba58 2024-08-24 02:30:50,410 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/38e50f85-6c97-4616-846c-bf5bc816ec49 2024-08-24 02:30:50,416 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/38e50f85-6c97-4616-846c-bf5bc816ec49 2024-08-24 02:30:50,422 - DEBUG - Requesting: http://10.0.0.52:8082/route-target/dadd28be-2809-489d-80b6-5f29b8944b23 2024-08-24 02:30:50,434 - DEBUG - Control-node 10.0.0.52 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-29127878', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10705773549494487681', 'uuid-lslong': '12110445763958389336'}, 'enable': 'true', 'created': '2024-08-24T02:30:49', 'last-modified': '2024-08-24T02:30:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.381367'} 2024-08-24 02:30:50,442 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-08-24 02:30:50,443 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-22106394 passed 2024-08-24 02:30:50,443 - DEBUG - ====Verifying policy data for ctest-right_vn-22106394 in API_Server ====== 2024-08-24 02:30:50,443 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:30:50,449 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:30:50,463 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:30:50,531 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-network/94928c52-5764-4a81-a810-f242285fba58 2024-08-24 02:30:50,539 - DEBUG - =>VN ctest-right_vn-22106394 has no policy to be verified 2024-08-24 02:30:50,539 - DEBUG - Verifying the vn in opserver 2024-08-24 02:30:50,539 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394 virtual network link through opserver 10.0.0.52 2024-08-24 02:30:50,539 - DEBUG - Requesting: http://10.0.0.52:8081/analytics/uves/virtual-networks 2024-08-24 02:30:50,550 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394', 'href': 'http://10.0.0.52:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394?flat'} 2024-08-24 02:30:50,550 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394 is found in opserver 2024-08-24 02:30:50,562 - DEBUG - Do not have enough data to verify VN in agent 2024-08-24 02:30:50,567 - DEBUG - VRF ids for VN ctest-right_vn-22106394: {} 2024-08-24 02:30:50,618 - DEBUG - Services list from nova: [, , ] 2024-08-24 02:30:51,615 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1738-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1738-1) 2024-08-24 02:30:52,683 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1738-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1738-1) 2024-08-24 02:30:52,684 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-88714957'] 2024-08-24 02:30:53,045 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-88714957'] created succesfully 2024-08-24 02:30:53,395 - DEBUG - Image by name cirros_in_net not found 2024-08-24 02:30:53,395 - DEBUG - Installing image cirros_in_net 2024-08-24 02:30:53,395 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'vcpath': '/images/vcenter/', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2024-08-24 02:30:53,396 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2024-08-24 02:30:53,396 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2024-08-24 02:30:53,410 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2024-08-24 02:30:53,665 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2024-08-24 02:30:53,665 - DEBUG - Unzip image 2024-08-24 02:30:53,665 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2024-08-24 02:30:53,814 - DEBUG - Try to create image in user context 2024-08-24 02:30:54,039 - DEBUG - Image has been created in user context 2024-08-24 02:30:54,039 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2024-08-24 02:30:54,052 - DEBUG - Downloaded image has been removed 2024-08-24 02:30:54,067 - DEBUG - Uploaded image status = active 2024-08-24 02:30:55,163 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1738-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1738-1) 2024-08-24 02:30:55,164 - INFO - Waiting for VM ctest-pt_svm0-40721726 to be up.. 2024-08-24 02:30:55,202 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-08-24 02:31:00,305 - DEBUG - VM is in ACTIVE state now 2024-08-24 02:31:00,305 - INFO - VM name : ctest-pt_svm0-40721726 2024-08-24 02:31:00,402 - DEBUG - VM ctest-pt_svm0-40721726 ID is cd198c70-f286-41f8-aa99-eae0a7b3017f 2024-08-24 02:31:00,423 - DEBUG - VM ctest-pt_svm0-40721726 launched on Node cn-jenkins-deploy-platform-ansible-os-1738-1 2024-08-24 02:31:00,711 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine/cd198c70-f286-41f8-aa99-eae0a7b3017f 2024-08-24 02:31:00,721 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/2e6cd4ca-9f4e-4a75-a7ad-8c8c63f07ff5 2024-08-24 02:31:00,729 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/73970268-8ccd-4129-bfa4-ad9cecb839e3 2024-08-24 02:31:00,739 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/f4ce3fca-fafd-43cd-a29d-d5e3891b2b19 2024-08-24 02:31:04,055 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2024-08-24 02:31:04,055 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-40721726 failed! 2024-08-24 02:31:04,109 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873 is 62.225.210.193 and allocation pool is NOT set 2024-08-24 02:31:08,184 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2024-08-24 02:31:08,184 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-40721726 failed! 2024-08-24 02:31:08,238 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873 is 62.225.210.193 and allocation pool is NOT set 2024-08-24 02:31:12,310 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2024-08-24 02:31:12,310 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-40721726 failed! 2024-08-24 02:31:12,361 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873 is 62.225.210.193 and allocation pool is NOT set 2024-08-24 02:31:16,444 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2024-08-24 02:31:16,444 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-40721726 failed! 2024-08-24 02:31:16,498 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873 is 62.225.210.193 and allocation pool is NOT set 2024-08-24 02:31:20,566 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2024-08-24 02:31:20,566 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-40721726 failed! 2024-08-24 02:31:20,621 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873 is 62.225.210.193 and allocation pool is NOT set 2024-08-24 02:31:22,685 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=6.38 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.581 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.581/3.479/6.378/2.898 ms') 2024-08-24 02:31:22,685 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-40721726 passed 2024-08-24 02:31:22,837 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:31:22,838 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40721726, IP 62.225.210.195, Port 22 2024-08-24 02:31:22,904 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-08-24 02:31:23,008 - DEBUG - VM ctest-pt_svm0-40721726 is NOT ready for SSH connections, VM status: ACTIVE 2024-08-24 02:31:28,009 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:31:28,009 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40721726, IP 62.225.210.195, Port 22 2024-08-24 02:31:28,065 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-08-24 02:31:28,145 - DEBUG - VM ctest-pt_svm0-40721726 is NOT ready for SSH connections, VM status: ACTIVE 2024-08-24 02:31:33,146 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:31:35,370 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40721726, IP 62.225.210.195, Port 22 2024-08-24 02:31:35,429 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-08-24 02:31:35,519 - DEBUG - VM ctest-pt_svm0-40721726 is NOT ready for SSH connections, VM status: ACTIVE 2024-08-24 02:31:40,520 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:31:40,521 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40721726, IP 62.225.210.195, Port 22 2024-08-24 02:31:40,577 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-08-24 02:31:40,658 - DEBUG - VM ctest-pt_svm0-40721726 is NOT ready for SSH connections, VM status: ACTIVE 2024-08-24 02:31:45,659 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:31:45,660 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40721726, IP 62.225.210.195, Port 22 2024-08-24 02:31:45,727 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-08-24 02:31:45,819 - DEBUG - VM ctest-pt_svm0-40721726 is NOT ready for SSH connections, VM status: ACTIVE 2024-08-24 02:31:50,820 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:31:50,820 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40721726, IP 62.225.210.195, Port 22 2024-08-24 02:31:50,981 - DEBUG - VM ctest-pt_svm0-40721726 is ready for SSH connections 2024-08-24 02:31:51,141 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:31:51,142 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40721726, IP 62.225.210.195, Port 22 2024-08-24 02:31:51,297 - DEBUG - VM ctest-pt_svm0-40721726 is ready for SSH connections 2024-08-24 02:31:51,445 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:31:51,446 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-40721726, IP 62.225.210.195, Port 22 2024-08-24 02:31:51,601 - DEBUG - VM ctest-pt_svm0-40721726 is ready for SSH connections 2024-08-24 02:31:51,607 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-29127878', 'ctest-si-02796876'] 2024-08-24 02:31:52,497 - INFO - Waiting for VM ctest-left_vm-46816272 to be up.. 2024-08-24 02:31:52,571 - DEBUG - VM is in ACTIVE state now 2024-08-24 02:31:52,571 - INFO - VM name : ctest-left_vm-46816272 2024-08-24 02:31:52,648 - DEBUG - VM ctest-left_vm-46816272 ID is 0c685c4a-5379-4d20-b0e0-593879557838 2024-08-24 02:31:52,649 - DEBUG - VM ctest-left_vm-46816272 launched on Node cn-jenkins-deploy-platform-ansible-os-1738-1 2024-08-24 02:31:52,723 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine/0c685c4a-5379-4d20-b0e0-593879557838 2024-08-24 02:31:52,731 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/2a3ec4aa-ab0b-4a76-bae9-b230cc3335e1 2024-08-24 02:31:53,966 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.75 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.330 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.330/1.538/2.747/1.208 ms') 2024-08-24 02:31:53,966 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-46816272 passed 2024-08-24 02:31:54,117 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:31:54,118 - DEBUG - Waiting to SSH to VM ctest-left_vm-46816272, IP 211.124.17.131, Port 22 2024-08-24 02:31:54,285 - DEBUG - VM ctest-left_vm-46816272 is ready for SSH connections 2024-08-24 02:31:54,285 - INFO - Waiting for VM ctest-right_vm-04682495 to be up.. 2024-08-24 02:31:54,356 - DEBUG - VM is in ACTIVE state now 2024-08-24 02:31:54,356 - INFO - VM name : ctest-right_vm-04682495 2024-08-24 02:31:54,428 - DEBUG - VM ctest-right_vm-04682495 ID is 5aaa2341-fae1-43a3-9b2d-a136ac868fea 2024-08-24 02:31:54,429 - DEBUG - VM ctest-right_vm-04682495 launched on Node cn-jenkins-deploy-platform-ansible-os-1738-1 2024-08-24 02:31:54,497 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine/5aaa2341-fae1-43a3-9b2d-a136ac868fea 2024-08-24 02:31:54,505 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/1fab8ca6-6f0a-45dd-9991-dc5adcfd65f1 2024-08-24 02:31:55,736 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.90 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.362 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.362/1.628/2.895/1.266 ms') 2024-08-24 02:31:55,736 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-right_vm-04682495 passed 2024-08-24 02:31:55,886 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:31:55,886 - DEBUG - Waiting to SSH to VM ctest-right_vm-04682495, IP 167.91.7.131, Port 22 2024-08-24 02:31:56,037 - DEBUG - VM ctest-right_vm-04682495 is ready for SSH connections 2024-08-24 02:31:56,044 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-29127878:ctest-si-02796876'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2024-08-24 02:31:56,473 - INFO - Attaching policy ctest-policy-40214213 to vn ctest-left_vn-90926401 2024-08-24 02:31:57,010 - INFO - Attaching policy ctest-policy-40214213 to vn ctest-right_vn-22106394 2024-08-24 02:31:57,441 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-88714957'] created succesfully 2024-08-24 02:31:57,657 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-29127878', 'ctest-si-02796876'] created succesfully 2024-08-24 02:31:57,658 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:31:57,664 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:31:57,678 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:31:57,752 - DEBUG - Requesting: http://10.0.0.52:8082/service-instance/63b9ab5d-8aae-490d-a637-76072b491924 2024-08-24 02:31:57,763 - DEBUG - SI 'ctest-si-02796876' has service template ref to ctest-service_template_1-88714957 2024-08-24 02:31:57,763 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:31:57,771 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:31:57,783 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:31:57,856 - DEBUG - Requesting: http://10.0.0.52:8082/service-instance/63b9ab5d-8aae-490d-a637-76072b491924 2024-08-24 02:31:57,867 - DEBUG - Requesting: http://10.0.0.52:8082/port-tuple/910038b0-ba60-435e-877c-e02fce7c87bf 2024-08-24 02:31:57,876 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/2e6cd4ca-9f4e-4a75-a7ad-8c8c63f07ff5 2024-08-24 02:31:57,891 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/73970268-8ccd-4129-bfa4-ad9cecb839e3 2024-08-24 02:31:57,901 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/f4ce3fca-fafd-43cd-a29d-d5e3891b2b19 2024-08-24 02:31:58,155 - DEBUG - VM is in ACTIVE state now 2024-08-24 02:31:58,569 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine/cd198c70-f286-41f8-aa99-eae0a7b3017f 2024-08-24 02:31:58,577 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/2e6cd4ca-9f4e-4a75-a7ad-8c8c63f07ff5 2024-08-24 02:31:58,586 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/73970268-8ccd-4129-bfa4-ad9cecb839e3 2024-08-24 02:31:58,594 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/f4ce3fca-fafd-43cd-a29d-d5e3891b2b19 2024-08-24 02:31:58,602 - DEBUG - Requesting: http://10.0.0.52:8082/instance-ip/187a4320-e4f3-403b-865e-f4b2ad85a7e3 2024-08-24 02:31:58,608 - DEBUG - Requesting: http://10.0.0.52:8082/instance-ip/94a341a0-7bd8-4181-b584-335075cccf0c 2024-08-24 02:31:58,614 - DEBUG - Requesting: http://10.0.0.52:8082/instance-ip/cdf34c0b-5ab7-4adf-9934-0c0af1078615 2024-08-24 02:31:58,621 - DEBUG - Requesting: http://10.0.0.52:8082/instance-ip/437f03bc-53a4-40c3-9abb-feef306737b1 2024-08-24 02:31:58,626 - DEBUG - Requesting: http://10.0.0.52:8082/instance-ip/64e7ee84-65aa-49c6-bca7-74007f8d2535 2024-08-24 02:31:58,634 - DEBUG - Requesting: http://10.0.0.52:8082/instance-ip/7506e49e-9742-4151-87a7-97accc3db003 2024-08-24 02:31:58,642 - DEBUG - Requesting: http://10.0.0.52:8082/instance-ip/06705c93-5af8-43cd-9ecd-192845d88c1f 2024-08-24 02:31:58,651 - DEBUG - Requesting: http://10.0.0.52:8082/instance-ip/41d46893-2003-441c-aab1-82e9325e4c52 2024-08-24 02:31:58,657 - DEBUG - Requesting: http://10.0.0.52:8082/instance-ip/7f7df561-87ea-49c1-a20d-239b27931315 2024-08-24 02:31:59,030 - DEBUG - VM is in ACTIVE state now 2024-08-24 02:31:59,030 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine/cd198c70-f286-41f8-aa99-eae0a7b3017f 2024-08-24 02:31:59,039 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/2e6cd4ca-9f4e-4a75-a7ad-8c8c63f07ff5 2024-08-24 02:31:59,050 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/73970268-8ccd-4129-bfa4-ad9cecb839e3 2024-08-24 02:31:59,059 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine-interface/f4ce3fca-fafd-43cd-a29d-d5e3891b2b19 2024-08-24 02:32:00,294 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=1.26 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.496 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.496/0.878/1.260/0.382 ms') 2024-08-24 02:32:00,294 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-40721726 passed 2024-08-24 02:32:00,330 - DEBUG - VM ctest-pt_svm0-40721726 Tap interface: {'index': '6', 'name': 'tap73970268-8c', 'uuid': '73970268-8ccd-4129-bfa4-ad9cecb839e3', 'vrf_name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401:ctest-left_vn-90926401', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401', 'vm_uuid': 'cd198c70-f286-41f8-aa99-eae0a7b3017f', 'vm_name': 'ctest-pt_svm0-40721726', 'ip_addr': '211.124.17.132', 'mac_addr': '02:73:97:02:68:8c', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-29127878:73970268-8ccd-4129-bfa4-ad9cecb839e3', 'sg_uuid_list': ['03262f08-a036-4d60-971a-ccd70a91360c'], 'static_route_list': None, 'vm_project_uuid': 'a055c7bf-2f37-48ad-b01b-9c2d53f69c5b', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'f4ce3fca-fafd-43cd-a29d-d5e3891b2b19', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-08-24 02:32:00,330 - DEBUG - Agent 10.0.0.52 vrf name: default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401:ctest-left_vn-90926401 2024-08-24 02:32:00,336 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401:ctest-left_vn-90926401', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401', 'table_label': '-1', 'vxlan_id': '8', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.6:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-08-24 02:32:00,498 - DEBUG - VM ctest-pt_svm0-40721726 : Tap interface tap73970268-8c is set to Active 2024-08-24 02:32:00,498 - DEBUG - Tap interface tap73970268-8c detail : {'index': '6', 'name': 'tap73970268-8c', 'uuid': '73970268-8ccd-4129-bfa4-ad9cecb839e3', 'vrf_name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401:ctest-left_vn-90926401', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401', 'vm_uuid': 'cd198c70-f286-41f8-aa99-eae0a7b3017f', 'vm_name': 'ctest-pt_svm0-40721726', 'ip_addr': '211.124.17.132', 'mac_addr': '02:73:97:02:68:8c', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-29127878:73970268-8ccd-4129-bfa4-ad9cecb839e3', 'sg_uuid_list': ['03262f08-a036-4d60-971a-ccd70a91360c'], 'static_route_list': None, 'vm_project_uuid': 'a055c7bf-2f37-48ad-b01b-9c2d53f69c5b', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'f4ce3fca-fafd-43cd-a29d-d5e3891b2b19', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-08-24 02:32:00,690 - DEBUG - Starting Layer 2 verification in Agent 2024-08-24 02:32:00,707 - DEBUG - Layer 2 path is seen for VM MAC 02:73:97:02:68:8c in agent 10.0.0.52 2024-08-24 02:32:00,707 - DEBUG - Active layer 2 route in agent is present for VMI tap73970268-8c 2024-08-24 02:32:00,707 - DEBUG - L2 label(48) matches bw route table and interface table 2024-08-24 02:32:00,714 - DEBUG - VN default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401 is found in Agent of node 10.0.0.52 2024-08-24 02:32:00,926 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401 is consistent in agent 10.0.0.52 2024-08-24 02:32:00,926 - DEBUG - Route for VM IP ['211.124.17.132'] is consistent in agent 10.0.0.52 2024-08-24 02:32:00,926 - DEBUG - VN default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401 verification for VM ctest-pt_svm0-40721726 in Agent 10.0.0.52 passed 2024-08-24 02:32:01,118 - DEBUG - Starting all layer 2 verification in agent 10.0.0.52 2024-08-24 02:32:01,131 - DEBUG - Route for VM MAC 02:73:97:02:68:8c is consistent in agent 10.0.0.52 2024-08-24 02:32:01,151 - DEBUG - VM ctest-pt_svm0-40721726 Tap interface: {'index': '5', 'name': 'tap2e6cd4ca-9f', 'uuid': '2e6cd4ca-9f4e-4a75-a7ad-8c8c63f07ff5', 'vrf_name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873:ctest-mgmt_vn-38885873', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873', 'vm_uuid': 'cd198c70-f286-41f8-aa99-eae0a7b3017f', 'vm_name': 'ctest-pt_svm0-40721726', 'ip_addr': '62.225.210.195', 'mac_addr': '02:2e:6c:d4:ca:9f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-29127878:2e6cd4ca-9f4e-4a75-a7ad-8c8c63f07ff5', 'sg_uuid_list': ['03262f08-a036-4d60-971a-ccd70a91360c'], 'static_route_list': None, 'vm_project_uuid': 'a055c7bf-2f37-48ad-b01b-9c2d53f69c5b', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-08-24 02:32:01,152 - DEBUG - Agent 10.0.0.52 vrf name: default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873:ctest-mgmt_vn-38885873 2024-08-24 02:32:01,157 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873:ctest-mgmt_vn-38885873', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873', 'table_label': '-1', 'vxlan_id': '7', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.6:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-08-24 02:32:01,318 - DEBUG - VM ctest-pt_svm0-40721726 : Tap interface tap2e6cd4ca-9f is set to Active 2024-08-24 02:32:01,318 - DEBUG - Tap interface tap2e6cd4ca-9f detail : {'index': '5', 'name': 'tap2e6cd4ca-9f', 'uuid': '2e6cd4ca-9f4e-4a75-a7ad-8c8c63f07ff5', 'vrf_name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873:ctest-mgmt_vn-38885873', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873', 'vm_uuid': 'cd198c70-f286-41f8-aa99-eae0a7b3017f', 'vm_name': 'ctest-pt_svm0-40721726', 'ip_addr': '62.225.210.195', 'mac_addr': '02:2e:6c:d4:ca:9f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-29127878:2e6cd4ca-9f4e-4a75-a7ad-8c8c63f07ff5', 'sg_uuid_list': ['03262f08-a036-4d60-971a-ccd70a91360c'], 'static_route_list': None, 'vm_project_uuid': 'a055c7bf-2f37-48ad-b01b-9c2d53f69c5b', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-08-24 02:32:01,509 - DEBUG - Starting Layer 2 verification in Agent 2024-08-24 02:32:01,521 - DEBUG - Layer 2 path is seen for VM MAC 02:2e:6c:d4:ca:9f in agent 10.0.0.52 2024-08-24 02:32:01,522 - DEBUG - Active layer 2 route in agent is present for VMI tap2e6cd4ca-9f 2024-08-24 02:32:01,522 - DEBUG - L2 label(43) matches bw route table and interface table 2024-08-24 02:32:01,527 - DEBUG - VN default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873 is found in Agent of node 10.0.0.52 2024-08-24 02:32:01,740 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873 is consistent in agent 10.0.0.52 2024-08-24 02:32:01,741 - DEBUG - Route for VM IP ['62.225.210.195'] is consistent in agent 10.0.0.52 2024-08-24 02:32:01,741 - DEBUG - VN default-domain:ctest-TestSvcRegr-29127878:ctest-mgmt_vn-38885873 verification for VM ctest-pt_svm0-40721726 in Agent 10.0.0.52 passed 2024-08-24 02:32:01,938 - DEBUG - Starting all layer 2 verification in agent 10.0.0.52 2024-08-24 02:32:01,953 - DEBUG - Route for VM MAC 02:2e:6c:d4:ca:9f is consistent in agent 10.0.0.52 2024-08-24 02:32:01,981 - DEBUG - VM ctest-pt_svm0-40721726 Tap interface: {'index': '7', 'name': 'tapf4ce3fca-fa', 'uuid': 'f4ce3fca-fafd-43cd-a29d-d5e3891b2b19', 'vrf_name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394:ctest-right_vn-22106394', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394', 'vm_uuid': 'cd198c70-f286-41f8-aa99-eae0a7b3017f', 'vm_name': 'ctest-pt_svm0-40721726', 'ip_addr': '167.91.7.132', 'mac_addr': '02:f4:ce:3f:ca:fa', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '30', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-29127878:f4ce3fca-fafd-43cd-a29d-d5e3891b2b19', 'sg_uuid_list': ['03262f08-a036-4d60-971a-ccd70a91360c'], 'static_route_list': None, 'vm_project_uuid': 'a055c7bf-2f37-48ad-b01b-9c2d53f69c5b', 'admin_state': 'Enabled', 'flow_key_idx': '26', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '73970268-8ccd-4129-bfa4-ad9cecb839e3', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-08-24 02:32:01,981 - DEBUG - Agent 10.0.0.52 vrf name: default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394:ctest-right_vn-22106394 2024-08-24 02:32:01,989 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394:ctest-right_vn-22106394', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394', 'table_label': '-1', 'vxlan_id': '9', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.6:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-08-24 02:32:02,155 - DEBUG - VM ctest-pt_svm0-40721726 : Tap interface tapf4ce3fca-fa is set to Active 2024-08-24 02:32:02,155 - DEBUG - Tap interface tapf4ce3fca-fa detail : {'index': '7', 'name': 'tapf4ce3fca-fa', 'uuid': 'f4ce3fca-fafd-43cd-a29d-d5e3891b2b19', 'vrf_name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394:ctest-right_vn-22106394', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394', 'vm_uuid': 'cd198c70-f286-41f8-aa99-eae0a7b3017f', 'vm_name': 'ctest-pt_svm0-40721726', 'ip_addr': '167.91.7.132', 'mac_addr': '02:f4:ce:3f:ca:fa', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '30', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-29127878:f4ce3fca-fafd-43cd-a29d-d5e3891b2b19', 'sg_uuid_list': ['03262f08-a036-4d60-971a-ccd70a91360c'], 'static_route_list': None, 'vm_project_uuid': 'a055c7bf-2f37-48ad-b01b-9c2d53f69c5b', 'admin_state': 'Enabled', 'flow_key_idx': '26', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '73970268-8ccd-4129-bfa4-ad9cecb839e3', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-08-24 02:32:02,345 - DEBUG - Starting Layer 2 verification in Agent 2024-08-24 02:32:02,357 - DEBUG - Layer 2 path is seen for VM MAC 02:f4:ce:3f:ca:fa in agent 10.0.0.52 2024-08-24 02:32:02,357 - DEBUG - Active layer 2 route in agent is present for VMI tapf4ce3fca-fa 2024-08-24 02:32:02,357 - DEBUG - L2 label(53) matches bw route table and interface table 2024-08-24 02:32:02,362 - DEBUG - VN default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394 is found in Agent of node 10.0.0.52 2024-08-24 02:32:02,579 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394 is consistent in agent 10.0.0.52 2024-08-24 02:32:02,579 - DEBUG - Route for VM IP ['167.91.7.132'] is consistent in agent 10.0.0.52 2024-08-24 02:32:02,579 - DEBUG - VN default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394 verification for VM ctest-pt_svm0-40721726 in Agent 10.0.0.52 passed 2024-08-24 02:32:02,770 - DEBUG - Starting all layer 2 verification in agent 10.0.0.52 2024-08-24 02:32:02,781 - DEBUG - Route for VM MAC 02:f4:ce:3f:ca:fa is consistent in agent 10.0.0.52 2024-08-24 02:32:02,781 - INFO - VM ctest-pt_svm0-40721726 verifications in Compute nodes passed 2024-08-24 02:32:02,782 - DEBUG - The SVMs in the SI are : [] 2024-08-24 02:32:02,782 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine/cd198c70-f286-41f8-aa99-eae0a7b3017f 2024-08-24 02:32:02,791 - DEBUG - Service VM for SI 'ctest-si-02796876' is launched 2024-08-24 02:32:02,791 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:32:02,797 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:32:02,809 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:32:02,876 - DEBUG - Requesting: http://10.0.0.52:8082/service-instance/63b9ab5d-8aae-490d-a637-76072b491924 2024-08-24 02:32:02,886 - DEBUG - SI ctest-si-02796876 has Port Tuple: ['ctest-port_tuple-11940146'] 2024-08-24 02:32:02,985 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-29127878:ctest-left_vn-90926401 2024-08-24 02:32:03,129 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-29127878:ctest-right_vn-22106394 2024-08-24 02:32:03,281 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:32:03,290 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:32:03,290 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:32:03,295 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:32:03,296 - INFO - Route to 167.91.7.131 seen in VRF:5 on cn-jenkins-deploy-platform-ansible-os-1738-1, and SI ctest-si-02796876 is seen as the NH 2024-08-24 02:32:03,452 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:32:03,459 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:32:03,459 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:32:03,465 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:32:03,465 - INFO - Route to 211.124.17.131 seen in VRF:6 on cn-jenkins-deploy-platform-ansible-os-1738-1, and SI ctest-si-02796876 is seen as the NH 2024-08-24 02:32:03,465 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:32:03,465 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-24 02:32:03,465 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 167.91.7.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.52, gateway password: c0ntrail123 2024-08-24 02:32:03,465 - DEBUG - ping -s 56 -c 3 -W 1 167.91.7.131 2024-08-24 02:32:07,375 - DEBUG - PING 167.91.7.131 (167.91.7.131): 56 data bytes 64 bytes from 167.91.7.131: seq=0 ttl=61 time=5.411 ms 64 bytes from 167.91.7.131: seq=1 ttl=61 time=1.430 ms 64 bytes from 167.91.7.131: seq=2 ttl=61 time=1.458 ms --- 167.91.7.131 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.430/2.766/5.411 ms 2024-08-24 02:32:07,375 - INFO - Ping to IP 167.91.7.131 from VM ctest-left_vm-46816272 passed 2024-08-24 02:32:07,375 - INFO - Dettaching policy ctest-policy-40214213 from vn ctest-right_vn-22106394 2024-08-24 02:32:07,589 - INFO - Dettaching policy ctest-policy-40214213 from vn ctest-left_vn-90926401 2024-08-24 02:32:08,376 - INFO - Deleted policy ctest-policy-40214213 2024-08-24 02:32:08,376 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-29127878', 'ctest-si-02796876'] 2024-08-24 02:32:08,488 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-29127878', 'ctest-si-02796876'] 2024-08-24 02:32:08,488 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:32:08,494 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:32:08,510 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:32:08,588 - DEBUG - Service instance ctest-si-02796876 removed from api server 2024-08-24 02:32:08,588 - DEBUG - Requesting: http://10.0.0.52:8082/virtual-machine/cd198c70-f286-41f8-aa99-eae0a7b3017f 2024-08-24 02:32:08,598 - DEBUG - All Service VMs unlinked from SI ctest-si-02796876 2024-08-24 02:32:08,606 - DEBUG - 0 svc intances found in all projects. They are [] 2024-08-24 02:32:08,606 - DEBUG - 0 svc intances found in current project. They are [] 2024-08-24 02:32:08,657 - DEBUG - 0 svc intances found in all projects. They are [] 2024-08-24 02:32:08,657 - DEBUG - 0 svc intances found in current project. They are [] 2024-08-24 02:32:08,657 - INFO - Deleting VM ctest-pt_svm0-40721726 2024-08-24 02:32:08,744 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-88714957'] 2024-08-24 02:32:08,833 - INFO - Service template: ['default-domain', 'ctest-service_template_1-88714957'] deleted successfully. 2024-08-24 02:32:08,834 - INFO - Deleting VM ctest-right_vm-04682495 2024-08-24 02:32:08,951 - INFO - Deleting VM ctest-left_vm-46816272 2024-08-24 02:32:09,026 - INFO - Deleting VN ctest-right_vn-22106394 2024-08-24 02:32:09,069 - DEBUG - VN 94928c52-5764-4a81-a810-f242285fba58 still in use: Unable to complete operation on network 94928c52-5764-4a81-a810-f242285fba58. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-373a9ada-e196-427d-b2cf-c9f5a9116c32'] 2024-08-24 02:32:09,070 - WARNING - Deleting VN ctest-right_vn-22106394 failed..Will retry 2024-08-24 02:32:11,172 - DEBUG - Response for deleting network () 2024-08-24 02:32:11,172 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/38e50f85-6c97-4616-846c-bf5bc816ec49 2024-08-24 02:32:11,180 - DEBUG - Response Code: 404 2024-08-24 02:32:11,180 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:32:11,187 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:32:11,243 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:32:11,314 - INFO - Validated that VN ctest-right_vn-22106394 is not found in API Server 2024-08-24 02:32:11,324 - DEBUG - VN ctest-right_vn-22106394 is not present in Agent 10.0.0.52 2024-08-24 02:32:11,325 - INFO - Validated that VN ctest-right_vn-22106394 is not in any agent 2024-08-24 02:32:11,339 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-22106394 info 2024-08-24 02:32:11,339 - INFO - Deleting VN ctest-left_vn-90926401 2024-08-24 02:32:11,443 - DEBUG - Response for deleting network () 2024-08-24 02:32:11,443 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/66719a2e-6fd4-4752-b0c1-8051a3e15f46 2024-08-24 02:32:11,450 - DEBUG - Response Code: 404 2024-08-24 02:32:11,450 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:32:11,455 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:32:11,510 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:32:11,582 - INFO - Validated that VN ctest-left_vn-90926401 is not found in API Server 2024-08-24 02:32:11,593 - DEBUG - VN ctest-left_vn-90926401 is not present in Agent 10.0.0.52 2024-08-24 02:32:11,593 - INFO - Validated that VN ctest-left_vn-90926401 is not in any agent 2024-08-24 02:32:11,609 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-90926401 info 2024-08-24 02:32:11,609 - INFO - Deleting VN ctest-mgmt_vn-38885873 2024-08-24 02:32:11,723 - DEBUG - Response for deleting network () 2024-08-24 02:32:11,723 - DEBUG - Requesting: http://10.0.0.52:8082/routing-instance/26c26ecf-3354-4626-a533-31ed5a36c774 2024-08-24 02:32:11,729 - DEBUG - Response Code: 404 2024-08-24 02:32:11,729 - DEBUG - Requesting: http://10.0.0.52:8082/domains 2024-08-24 02:32:11,734 - DEBUG - Requesting: http://10.0.0.52:8082/domain/1acddb76-cfec-497d-a36a-862dcf33412a 2024-08-24 02:32:11,787 - DEBUG - Requesting: http://10.0.0.52:8082/project/a055c7bf-2f37-48ad-b01b-9c2d53f69c5b 2024-08-24 02:32:11,856 - INFO - Validated that VN ctest-mgmt_vn-38885873 is not found in API Server 2024-08-24 02:32:11,866 - DEBUG - VN ctest-mgmt_vn-38885873 is not present in Agent 10.0.0.52 2024-08-24 02:32:11,866 - INFO - Validated that VN ctest-mgmt_vn-38885873 is not in any agent 2024-08-24 02:32:11,881 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-38885873 info 2024-08-24 02:32:12,139 - DEBUG - No XMPP flaps were noticed during the test 2024-08-24 02:32:12,139 - INFO -
2024-08-24 02:32:12,139 - INFO - END TEST : test_svc_in_network_datapath : PASSED[0:01:26]
2024-08-24 02:32:12,139 - INFO - -------------------------------------------------------------------------------- 2024-08-24 02:32:12,795 - INFO - Deleted project: ctest-TestSvcRegr-29127878, ID : a055c7bf-2f37-48ad-b01b-9c2d53f69c5b