2025-07-21 13:33:01,397 - INFO - Domain Default found not creating
2025-07-21 13:33:01,610 - INFO - Project ctest-TestSvcRegr-66955652 not found, creating it
2025-07-21 13:33:02,187 - INFO - Created Project:ctest-TestSvcRegr-66955652, ID : 5c22cac3-59ad-4121-b0a6-d47b50d8c35a 
2025-07-21 13:33:04,523 - INFO - ================================================================================
2025-07-21 13:33:04,523 - INFO - STARTING TEST    : test_svc_in_net_nat_with_static_routes
2025-07-21 13:33:04,863 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with
2025-07-21 13:33:04,863 - INFO - Initial checks done. Running the testcase now
2025-07-21 13:33:04,863 - INFO - 
2025-07-21 13:33:05,710 - DEBUG - Response for create_network : {'network': {'id': '4d9aa063-014b-444e-8cc6-2c63fa3970a7', 'name': 'ctest-third-vn-10500878', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-66955652', 'ctest-third-vn-10500878'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:33:05,975 - DEBUG - Response for create_subnet : {'subnet': {'id': '2725a92d-347b-4a0d-a5dc-578a63db12bb', 'name': '', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'network_id': '4d9aa063-014b-444e-8cc6-2c63fa3970a7', 'ip_version': 4, 'cidr': '23.42.176.0/26', 'allocation_pools': [{'start': '23.42.176.2', 'end': '23.42.176.62'}], 'gateway_ip': '23.42.176.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '23.42.176.2', 'tags': [], 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a'}}
2025-07-21 13:33:06,001 - INFO - Created VN ctest-third-vn-10500878
2025-07-21 13:33:06,065 - DEBUG - VN ctest-third-vn-10500878 UUID is 4d9aa063-014b-444e-8cc6-2c63fa3970a7
2025-07-21 13:33:06,364 - DEBUG - Services list from nova: [<Service: 1>, <Service: 1>, <Service: 2>]
2025-07-21 13:33:08,425 - INFO - VM ([<Server: ctest-vm-in-third-vn-40489988>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:33:08,531 - DEBUG - VM <Server: ctest-vm-in-third-vn-40489988> is still in BUILD state, Expected: ACTIVE
2025-07-21 13:33:13,710 - DEBUG - VM <Server: ctest-vm-in-third-vn-40489988> is in ACTIVE state now
2025-07-21 13:33:14,136 - DEBUG - Response for create_network : {'network': {'id': 'f09a79b7-8118-4acc-9c8d-039bd290faec', 'name': 'ctest-mgmt_vn-47640326', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-66955652', 'ctest-mgmt_vn-47640326'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:33:14,334 - DEBUG - Response for create_subnet : {'subnet': {'id': '617e09a1-f417-4784-8d0b-54e476496901', 'name': '', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'network_id': 'f09a79b7-8118-4acc-9c8d-039bd290faec', 'ip_version': 4, 'cidr': '143.30.125.192/26', 'allocation_pools': [{'start': '143.30.125.194', 'end': '143.30.125.254'}], 'gateway_ip': '143.30.125.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '143.30.125.194', 'tags': [], 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a'}}
2025-07-21 13:33:14,375 - INFO - Created VN ctest-mgmt_vn-47640326
2025-07-21 13:33:14,453 - DEBUG - VN ctest-mgmt_vn-47640326 UUID is f09a79b7-8118-4acc-9c8d-039bd290faec
2025-07-21 13:33:14,642 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:14,996 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:15,058 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:15,090 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:15,210 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f09a79b7-8118-4acc-9c8d-039bd290faec
2025-07-21 13:33:15,235 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f09a79b7-8118-4acc-9c8d-039bd290faec
2025-07-21 13:33:15,253 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/65adc443-8eab-41c1-9744-edf5c2256746
2025-07-21 13:33:15,265 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/65adc443-8eab-41c1-9744-edf5c2256746
2025-07-21 13:33:15,277 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/2993fd7a-4fdf-483b-89ae-add7aa7548a7
2025-07-21 13:33:15,290 - DEBUG - Route Targets: ['target:64512:8000012']
2025-07-21 13:33:15,290 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f09a79b7-8118-4acc-9c8d-039bd290faec
2025-07-21 13:33:15,309 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/65adc443-8eab-41c1-9744-edf5c2256746
2025-07-21 13:33:15,338 - INFO - Verified VN network id 17 for VN f09a79b7-8118-4acc-9c8d-039bd290faec
2025-07-21 13:33:15,339 - INFO - Verifications in API Server for VN ctest-mgmt_vn-47640326 passed
2025-07-21 13:33:15,339 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f09a79b7-8118-4acc-9c8d-039bd290faec
2025-07-21 13:33:15,362 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/65adc443-8eab-41c1-9744-edf5c2256746
2025-07-21 13:33:15,377 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/65adc443-8eab-41c1-9744-edf5c2256746
2025-07-21 13:33:15,391 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/2993fd7a-4fdf-483b-89ae-add7aa7548a7
2025-07-21 13:33:15,416 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-66955652:ctest-mgmt_vn-47640326', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-66955652', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17337303544567974604', 'uuid-lslong': '11280676609420491500'}, 'enable': 'true', 'created': '2025-07-21T13:33:14', 'last-modified': '2025-07-21T13:33:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.135042'}
2025-07-21 13:33:15,428 - DEBUG - Route Targets: ['target:64512:8000012']
2025-07-21 13:33:15,429 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-47640326 passed
2025-07-21 13:33:15,429 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-47640326 in API_Server ======
2025-07-21 13:33:15,429 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:15,440 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:15,466 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:15,573 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f09a79b7-8118-4acc-9c8d-039bd290faec
2025-07-21 13:33:15,594 - DEBUG - =>VN ctest-mgmt_vn-47640326 has no policy to be verified
2025-07-21 13:33:15,594 - DEBUG - Verifying the vn in opserver
2025-07-21 13:33:15,594 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66955652:ctest-mgmt_vn-47640326 virtual network link  through opserver 10.0.0.254
2025-07-21 13:33:15,595 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:33:15,924 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:33:16,004 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-66955652:ctest-mgmt_vn-47640326', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-66955652:ctest-mgmt_vn-47640326?flat'}
2025-07-21 13:33:16,004 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-66955652:ctest-mgmt_vn-47640326 is found in opserver
2025-07-21 13:33:16,031 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:33:16,040 - DEBUG - VRF ids for VN ctest-mgmt_vn-47640326: {}
2025-07-21 13:33:16,370 - DEBUG - Response for create_network : {'network': {'id': '0dff768c-f282-4da7-b758-5dc615c4a96c', 'name': 'ctest-left_vn-77688886', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-66955652', 'ctest-left_vn-77688886'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:33:16,612 - DEBUG - Response for create_subnet : {'subnet': {'id': 'edfb9309-6510-4a22-aae2-835080b8a52e', 'name': '', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'network_id': '0dff768c-f282-4da7-b758-5dc615c4a96c', 'ip_version': 4, 'cidr': '53.70.178.128/26', 'allocation_pools': [{'start': '53.70.178.130', 'end': '53.70.178.190'}], 'gateway_ip': '53.70.178.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '53.70.178.130', 'tags': [], 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a'}}
2025-07-21 13:33:16,640 - INFO - Created VN ctest-left_vn-77688886
2025-07-21 13:33:16,705 - DEBUG - VN ctest-left_vn-77688886 UUID is 0dff768c-f282-4da7-b758-5dc615c4a96c
2025-07-21 13:33:16,915 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:16,930 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:16,965 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:17,111 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0dff768c-f282-4da7-b758-5dc615c4a96c
2025-07-21 13:33:17,143 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0dff768c-f282-4da7-b758-5dc615c4a96c
2025-07-21 13:33:17,162 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/98a51adb-5482-42bb-a791-dedbd7ab3fd7
2025-07-21 13:33:17,178 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/98a51adb-5482-42bb-a791-dedbd7ab3fd7
2025-07-21 13:33:17,192 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/9d9ce7ca-b884-4974-96e8-d90460037640
2025-07-21 13:33:17,204 - DEBUG - Route Targets: ['target:64512:8000013']
2025-07-21 13:33:17,204 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0dff768c-f282-4da7-b758-5dc615c4a96c
2025-07-21 13:33:17,222 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/98a51adb-5482-42bb-a791-dedbd7ab3fd7
2025-07-21 13:33:17,254 - INFO - Verified VN network id 18 for VN 0dff768c-f282-4da7-b758-5dc615c4a96c
2025-07-21 13:33:17,254 - INFO - Verifications in API Server for VN ctest-left_vn-77688886 passed
2025-07-21 13:33:17,254 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0dff768c-f282-4da7-b758-5dc615c4a96c
2025-07-21 13:33:17,279 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/98a51adb-5482-42bb-a791-dedbd7ab3fd7
2025-07-21 13:33:17,295 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/98a51adb-5482-42bb-a791-dedbd7ab3fd7
2025-07-21 13:33:17,310 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/9d9ce7ca-b884-4974-96e8-d90460037640
2025-07-21 13:33:17,333 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-66955652:ctest-left_vn-77688886', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-66955652', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1008655189290405287', 'uuid-lslong': '13211412612241467756'}, 'enable': 'true', 'created': '2025-07-21T13:33:16', 'last-modified': '2025-07-21T13:33:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.759760'}
2025-07-21 13:33:17,349 - DEBUG - Route Targets: ['target:64512:8000013']
2025-07-21 13:33:17,349 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-77688886 passed
2025-07-21 13:33:17,349 - DEBUG - ====Verifying policy data for ctest-left_vn-77688886 in API_Server ======
2025-07-21 13:33:17,349 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:17,361 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:17,388 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:17,526 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0dff768c-f282-4da7-b758-5dc615c4a96c
2025-07-21 13:33:17,555 - DEBUG - =>VN ctest-left_vn-77688886 has no policy to be verified
2025-07-21 13:33:17,555 - DEBUG - Verifying the vn in opserver
2025-07-21 13:33:17,555 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66955652:ctest-left_vn-77688886 virtual network link  through opserver 10.0.0.254
2025-07-21 13:33:17,556 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:33:17,591 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-66955652:ctest-left_vn-77688886', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-66955652:ctest-left_vn-77688886?flat'}
2025-07-21 13:33:17,591 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-66955652:ctest-left_vn-77688886 is found in opserver
2025-07-21 13:33:17,639 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:33:17,656 - DEBUG - VRF ids for VN ctest-left_vn-77688886: {}
2025-07-21 13:33:18,057 - DEBUG - Response for create_network : {'network': {'id': 'b6048e4a-ce6f-4bdd-8b02-7066968fbe86', 'name': 'ctest-right_vn-98487799', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-66955652', 'ctest-right_vn-98487799'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:33:18,358 - DEBUG - Response for create_subnet : {'subnet': {'id': '4684f1d7-b218-4d86-8de6-e0e56724abdc', 'name': '', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'network_id': 'b6048e4a-ce6f-4bdd-8b02-7066968fbe86', 'ip_version': 4, 'cidr': '133.201.130.192/26', 'allocation_pools': [{'start': '133.201.130.194', 'end': '133.201.130.254'}], 'gateway_ip': '133.201.130.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '133.201.130.194', 'tags': [], 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a'}}
2025-07-21 13:33:18,379 - INFO - Created VN ctest-right_vn-98487799
2025-07-21 13:33:18,433 - DEBUG - VN ctest-right_vn-98487799 UUID is b6048e4a-ce6f-4bdd-8b02-7066968fbe86
2025-07-21 13:33:18,602 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:18,623 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:18,662 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:18,791 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b6048e4a-ce6f-4bdd-8b02-7066968fbe86
2025-07-21 13:33:18,824 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b6048e4a-ce6f-4bdd-8b02-7066968fbe86
2025-07-21 13:33:18,858 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/03c598c0-73a5-4aee-9f20-6d48f1809619
2025-07-21 13:33:18,879 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/03c598c0-73a5-4aee-9f20-6d48f1809619
2025-07-21 13:33:18,894 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/249aa1f7-e5ad-403f-8251-83aba28713cf
2025-07-21 13:33:18,906 - DEBUG - Route Targets: ['target:64512:8000014']
2025-07-21 13:33:18,906 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b6048e4a-ce6f-4bdd-8b02-7066968fbe86
2025-07-21 13:33:18,925 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/03c598c0-73a5-4aee-9f20-6d48f1809619
2025-07-21 13:33:18,955 - INFO - Verified VN network id 19 for VN b6048e4a-ce6f-4bdd-8b02-7066968fbe86
2025-07-21 13:33:18,955 - INFO - Verifications in API Server for VN ctest-right_vn-98487799 passed
2025-07-21 13:33:18,956 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b6048e4a-ce6f-4bdd-8b02-7066968fbe86
2025-07-21 13:33:18,974 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/03c598c0-73a5-4aee-9f20-6d48f1809619
2025-07-21 13:33:18,987 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/03c598c0-73a5-4aee-9f20-6d48f1809619
2025-07-21 13:33:19,003 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/249aa1f7-e5ad-403f-8251-83aba28713cf
2025-07-21 13:33:19,032 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-66955652:ctest-right_vn-98487799', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-66955652', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13115764466751851485', 'uuid-lslong': '10016692107140382342'}, 'enable': 'true', 'created': '2025-07-21T13:33:17', 'last-modified': '2025-07-21T13:33:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.723211'}
2025-07-21 13:33:19,047 - DEBUG - Route Targets: ['target:64512:8000014']
2025-07-21 13:33:19,048 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-98487799 passed
2025-07-21 13:33:19,048 - DEBUG - ====Verifying policy data for ctest-right_vn-98487799 in API_Server ======
2025-07-21 13:33:19,048 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:19,063 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:19,096 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:19,208 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b6048e4a-ce6f-4bdd-8b02-7066968fbe86
2025-07-21 13:33:19,219 - DEBUG - =>VN ctest-right_vn-98487799 has no policy to be verified
2025-07-21 13:33:19,219 - DEBUG - Verifying the vn in opserver
2025-07-21 13:33:19,219 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66955652:ctest-right_vn-98487799 virtual network link  through opserver 10.0.0.254
2025-07-21 13:33:19,219 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:33:19,236 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-66955652:ctest-right_vn-98487799', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-66955652:ctest-right_vn-98487799?flat'}
2025-07-21 13:33:19,236 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-66955652:ctest-right_vn-98487799 is found in opserver
2025-07-21 13:33:19,252 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:33:19,264 - DEBUG - VRF ids for VN ctest-right_vn-98487799: {}
2025-07-21 13:33:21,271 - INFO - VM ([<Server: ctest-left_vm-13136450>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:33:23,046 - INFO - VM ([<Server: ctest-right_vm-71758336>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:33:23,047 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-29107186']
2025-07-21 13:33:23,384 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-29107186'] created succesfully
2025-07-21 13:33:23,840 - DEBUG - Image by name tiny_nat_fw not found
2025-07-21 13:33:23,841 - DEBUG - Installing image tiny_nat_fw
2025-07-21 13:33:23,841 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmtx', 'vcname': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmdk', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-07-21 13:33:23,841 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz
2025-07-21 13:33:23,841 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz
2025-07-21 13:33:23,857 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz -O /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-21 13:33:23,891 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-21 13:33:23,892 - DEBUG - Unzip image
2025-07-21 13:33:23,892 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-21 13:33:23,909 - DEBUG - Try to create image in user context
2025-07-21 13:33:23,991 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-29107186']
2025-07-21 13:33:24,080 - INFO - Service template: ['default-domain', 'ctest-service_template_1-29107186'] deleted successfully.
2025-07-21 13:33:24,080 - INFO - Skip interface_detach for VM ctest-right_vm-71758336 in state BUILD
2025-07-21 13:33:24,081 - INFO - Deleting VM ctest-right_vm-71758336
2025-07-21 13:33:24,099 - ERROR - VM ctest-right_vm-71758336 has failed to come up
2025-07-21 13:33:24,099 - ERROR - Nova failed to get host of the VM
2025-07-21 13:33:24,213 - INFO - Skip interface_detach for VM ctest-left_vm-13136450 in state BUILD
2025-07-21 13:33:24,213 - INFO - Deleting VM ctest-left_vm-13136450
2025-07-21 13:33:24,213 - ERROR - VM ctest-left_vm-13136450 has failed to come up
2025-07-21 13:33:24,213 - ERROR - Nova failed to get host of the VM
2025-07-21 13:33:24,301 - INFO - Deleting VN ctest-right_vn-98487799 
2025-07-21 13:33:24,342 - DEBUG - VN b6048e4a-ce6f-4bdd-8b02-7066968fbe86 still in use: Unable to complete operation on network b6048e4a-ce6f-4bdd-8b02-7066968fbe86. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d6789f8f-8739-4259-83b2-7fca632394b4']
2025-07-21 13:33:24,342 - WARNING - Deleting VN ctest-right_vn-98487799 failed..Will retry
2025-07-21 13:33:26,630 - DEBUG - Response for deleting network ()
2025-07-21 13:33:26,630 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/03c598c0-73a5-4aee-9f20-6d48f1809619
2025-07-21 13:33:26,644 - DEBUG - Response Code: 404
2025-07-21 13:33:26,644 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:26,655 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:26,683 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:26,799 - INFO - Validated that VN ctest-right_vn-98487799 is not found in API Server
2025-07-21 13:33:26,825 - DEBUG - VN ctest-right_vn-98487799 is not present in Agent 10.0.0.254 
2025-07-21 13:33:26,825 - INFO - Validated that VN ctest-right_vn-98487799 is not in any agent
2025-07-21 13:33:26,875 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-98487799 info
2025-07-21 13:33:26,875 - INFO - Deleting VN ctest-left_vn-77688886 
2025-07-21 13:33:27,133 - DEBUG - Response for deleting network ()
2025-07-21 13:33:27,133 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/98a51adb-5482-42bb-a791-dedbd7ab3fd7
2025-07-21 13:33:27,144 - DEBUG - Response Code: 404
2025-07-21 13:33:27,145 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:27,157 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:27,220 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:27,348 - INFO - Validated that VN ctest-left_vn-77688886 is not found in API Server
2025-07-21 13:33:27,380 - DEBUG - VN ctest-left_vn-77688886 is not present in Agent 10.0.0.254 
2025-07-21 13:33:27,381 - INFO - Validated that VN ctest-left_vn-77688886 is not in any agent
2025-07-21 13:33:27,418 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-77688886 info
2025-07-21 13:33:27,419 - INFO - Deleting VN ctest-mgmt_vn-47640326 
2025-07-21 13:33:27,624 - DEBUG - Response for deleting network ()
2025-07-21 13:33:27,624 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/65adc443-8eab-41c1-9744-edf5c2256746
2025-07-21 13:33:27,630 - DEBUG - Response Code: 404
2025-07-21 13:33:27,630 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:27,636 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:27,696 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:27,792 - INFO - Validated that VN ctest-mgmt_vn-47640326 is not found in API Server
2025-07-21 13:33:27,812 - DEBUG - VN ctest-mgmt_vn-47640326 is not present in Agent 10.0.0.254 
2025-07-21 13:33:27,812 - INFO - Validated that VN ctest-mgmt_vn-47640326 is not in any agent
2025-07-21 13:33:27,841 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-47640326 info
2025-07-21 13:33:27,841 - INFO - Deleting VM ctest-vm-in-third-vn-40489988
2025-07-21 13:33:27,962 - INFO - Deleting VN ctest-third-vn-10500878 
2025-07-21 13:33:28,016 - DEBUG - VN 4d9aa063-014b-444e-8cc6-2c63fa3970a7 still in use: Unable to complete operation on network 4d9aa063-014b-444e-8cc6-2c63fa3970a7. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-376eee8c-5001-4b9e-ad4d-a59eaddb9ce5']
2025-07-21 13:33:28,016 - WARNING - Deleting VN ctest-third-vn-10500878 failed..Will retry
2025-07-21 13:33:30,222 - DEBUG - Response for deleting network ()
2025-07-21 13:33:30,528 - ERROR - <pre>Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_firewall/test_svc_fw.py", line 49, in test_svc_in_net_nat_with_static_routes
    static_route={'left': routes})
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network-nat.qcow2'
</pre>

2025-07-21 13:33:30,548 - DEBUG - No XMPP flaps were noticed during the test
2025-07-21 13:33:30,548 - INFO - 
2025-07-21 13:33:30,549 - INFO - END TEST : test_svc_in_net_nat_with_static_routes : FAILED[0:00:26]
2025-07-21 13:33:30,549 - INFO - --------------------------------------------------------------------------------
2025-07-21 13:33:30,561 - INFO - ================================================================================
2025-07-21 13:33:30,561 - INFO - STARTING TEST    : test_svc_v2_transparent_datapath
2025-07-21 13:33:30,902 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with
2025-07-21 13:33:30,902 - INFO - Initial checks done. Running the testcase now
2025-07-21 13:33:30,902 - INFO - 
2025-07-21 13:33:31,310 - DEBUG - Response for create_network : {'network': {'id': '7366a7b1-8b4e-4fa9-9b8d-19a94f8d1533', 'name': 'ctest-mgmt_vn-26209858', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-66955652', 'ctest-mgmt_vn-26209858'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:33:31,560 - DEBUG - Response for create_subnet : {'subnet': {'id': '5a52b350-dbe9-4594-af59-5e9c6c23befc', 'name': '', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'network_id': '7366a7b1-8b4e-4fa9-9b8d-19a94f8d1533', 'ip_version': 4, 'cidr': '95.215.17.64/26', 'allocation_pools': [{'start': '95.215.17.66', 'end': '95.215.17.126'}], 'gateway_ip': '95.215.17.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '95.215.17.66', 'tags': [], 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a'}}
2025-07-21 13:33:31,589 - INFO - Created VN ctest-mgmt_vn-26209858
2025-07-21 13:33:31,653 - DEBUG - VN ctest-mgmt_vn-26209858 UUID is 7366a7b1-8b4e-4fa9-9b8d-19a94f8d1533
2025-07-21 13:33:31,831 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:31,842 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:31,871 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:32,005 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7366a7b1-8b4e-4fa9-9b8d-19a94f8d1533
2025-07-21 13:33:32,030 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7366a7b1-8b4e-4fa9-9b8d-19a94f8d1533
2025-07-21 13:33:32,056 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c1077776-50e3-4682-9138-7db53b9e42d7
2025-07-21 13:33:32,075 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c1077776-50e3-4682-9138-7db53b9e42d7
2025-07-21 13:33:32,098 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/75a037cb-7ec3-4c50-9b87-31fc0f7ca128
2025-07-21 13:33:32,119 - DEBUG - Route Targets: ['target:64512:8000011']
2025-07-21 13:33:32,120 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7366a7b1-8b4e-4fa9-9b8d-19a94f8d1533
2025-07-21 13:33:32,150 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c1077776-50e3-4682-9138-7db53b9e42d7
2025-07-21 13:33:32,199 - INFO - Verified VN network id 16 for VN 7366a7b1-8b4e-4fa9-9b8d-19a94f8d1533
2025-07-21 13:33:32,199 - INFO - Verifications in API Server for VN ctest-mgmt_vn-26209858 passed
2025-07-21 13:33:32,200 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7366a7b1-8b4e-4fa9-9b8d-19a94f8d1533
2025-07-21 13:33:32,233 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c1077776-50e3-4682-9138-7db53b9e42d7
2025-07-21 13:33:32,258 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c1077776-50e3-4682-9138-7db53b9e42d7
2025-07-21 13:33:32,283 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/75a037cb-7ec3-4c50-9b87-31fc0f7ca128
2025-07-21 13:33:32,324 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-66955652:ctest-mgmt_vn-26209858', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-66955652', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8315518142974414761', 'uuid-lslong': '11208643262569846067'}, 'enable': 'true', 'created': '2025-07-21T13:33:31', 'last-modified': '2025-07-21T13:33:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.805657'}
2025-07-21 13:33:32,347 - DEBUG - Route Targets: ['target:64512:8000011']
2025-07-21 13:33:32,347 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-26209858 passed
2025-07-21 13:33:32,348 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-26209858 in API_Server ======
2025-07-21 13:33:32,348 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:32,364 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:32,402 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:32,545 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7366a7b1-8b4e-4fa9-9b8d-19a94f8d1533
2025-07-21 13:33:32,576 - DEBUG - =>VN ctest-mgmt_vn-26209858 has no policy to be verified
2025-07-21 13:33:32,576 - DEBUG - Verifying the vn in opserver
2025-07-21 13:33:32,576 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66955652:ctest-mgmt_vn-26209858 virtual network link  through opserver 10.0.0.254
2025-07-21 13:33:32,577 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:33:32,599 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-66955652:ctest-mgmt_vn-26209858', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-66955652:ctest-mgmt_vn-26209858?flat'}
2025-07-21 13:33:32,599 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-66955652:ctest-mgmt_vn-26209858 is found in opserver
2025-07-21 13:33:32,620 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:33:32,634 - DEBUG - VRF ids for VN ctest-mgmt_vn-26209858: {}
2025-07-21 13:33:32,985 - DEBUG - Response for create_network : {'network': {'id': '17788212-35c4-4c57-b067-7cb56f899e1a', 'name': 'ctest-left_vn-39844670', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-66955652', 'ctest-left_vn-39844670'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:33:33,192 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cffcbe1f-2afa-46c8-a120-73b98330d6be', 'name': '', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'network_id': '17788212-35c4-4c57-b067-7cb56f899e1a', 'ip_version': 4, 'cidr': '216.200.93.128/26', 'allocation_pools': [{'start': '216.200.93.130', 'end': '216.200.93.190'}], 'gateway_ip': '216.200.93.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '216.200.93.130', 'tags': [], 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a'}}
2025-07-21 13:33:33,218 - INFO - Created VN ctest-left_vn-39844670
2025-07-21 13:33:33,281 - DEBUG - VN ctest-left_vn-39844670 UUID is 17788212-35c4-4c57-b067-7cb56f899e1a
2025-07-21 13:33:33,417 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:33,425 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:33,445 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:33,537 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/17788212-35c4-4c57-b067-7cb56f899e1a
2025-07-21 13:33:33,564 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/17788212-35c4-4c57-b067-7cb56f899e1a
2025-07-21 13:33:33,588 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a9a61673-7f64-4b2c-af61-44c3f0a350d4
2025-07-21 13:33:33,613 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a9a61673-7f64-4b2c-af61-44c3f0a350d4
2025-07-21 13:33:33,635 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/acb4185f-405d-459c-b036-8e78621530ac
2025-07-21 13:33:33,654 - DEBUG - Route Targets: ['target:64512:8000012']
2025-07-21 13:33:33,654 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/17788212-35c4-4c57-b067-7cb56f899e1a
2025-07-21 13:33:33,676 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a9a61673-7f64-4b2c-af61-44c3f0a350d4
2025-07-21 13:33:33,724 - INFO - Verified VN network id 17 for VN 17788212-35c4-4c57-b067-7cb56f899e1a
2025-07-21 13:33:33,724 - INFO - Verifications in API Server for VN ctest-left_vn-39844670 passed
2025-07-21 13:33:33,725 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/17788212-35c4-4c57-b067-7cb56f899e1a
2025-07-21 13:33:33,745 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a9a61673-7f64-4b2c-af61-44c3f0a350d4
2025-07-21 13:33:33,758 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a9a61673-7f64-4b2c-af61-44c3f0a350d4
2025-07-21 13:33:33,776 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/acb4185f-405d-459c-b036-8e78621530ac
2025-07-21 13:33:33,801 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-66955652:ctest-left_vn-39844670', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-66955652', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1691244674800700503', 'uuid-lslong': '12711265591978728986'}, 'enable': 'true', 'created': '2025-07-21T13:33:32', 'last-modified': '2025-07-21T13:33:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.658649'}
2025-07-21 13:33:33,816 - DEBUG - Route Targets: ['target:64512:8000012']
2025-07-21 13:33:33,817 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-39844670 passed
2025-07-21 13:33:33,817 - DEBUG - ====Verifying policy data for ctest-left_vn-39844670 in API_Server ======
2025-07-21 13:33:33,817 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:33,827 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:33,849 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:33,961 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/17788212-35c4-4c57-b067-7cb56f899e1a
2025-07-21 13:33:33,980 - DEBUG - =>VN ctest-left_vn-39844670 has no policy to be verified
2025-07-21 13:33:33,980 - DEBUG - Verifying the vn in opserver
2025-07-21 13:33:33,981 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66955652:ctest-left_vn-39844670 virtual network link  through opserver 10.0.0.254
2025-07-21 13:33:33,981 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:33:34,005 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-66955652:ctest-left_vn-39844670', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-66955652:ctest-left_vn-39844670?flat'}
2025-07-21 13:33:34,005 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-66955652:ctest-left_vn-39844670 is found in opserver
2025-07-21 13:33:34,040 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:33:34,056 - DEBUG - VRF ids for VN ctest-left_vn-39844670: {}
2025-07-21 13:33:34,341 - DEBUG - Response for create_network : {'network': {'id': 'f319d8d6-e323-42ad-9791-56b061daefee', 'name': 'ctest-right_vn-96660336', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-66955652', 'ctest-right_vn-96660336'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:33:34,654 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ae2661dd-a1f6-43a9-8d9a-ced0e8a4f8e0', 'name': '', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'network_id': 'f319d8d6-e323-42ad-9791-56b061daefee', 'ip_version': 4, 'cidr': '39.51.9.0/26', 'allocation_pools': [{'start': '39.51.9.2', 'end': '39.51.9.62'}], 'gateway_ip': '39.51.9.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '39.51.9.2', 'tags': [], 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a'}}
2025-07-21 13:33:34,694 - INFO - Created VN ctest-right_vn-96660336
2025-07-21 13:33:34,757 - DEBUG - VN ctest-right_vn-96660336 UUID is f319d8d6-e323-42ad-9791-56b061daefee
2025-07-21 13:33:34,930 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:34,946 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:34,974 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:35,056 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f319d8d6-e323-42ad-9791-56b061daefee
2025-07-21 13:33:35,070 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f319d8d6-e323-42ad-9791-56b061daefee
2025-07-21 13:33:35,082 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9fed8441-b91f-4ad1-8512-ffad93a7655a
2025-07-21 13:33:35,092 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9fed8441-b91f-4ad1-8512-ffad93a7655a
2025-07-21 13:33:35,101 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/70dca082-cbb7-4abe-90bf-37cb08f61f87
2025-07-21 13:33:35,110 - DEBUG - Route Targets: ['target:64512:8000013']
2025-07-21 13:33:35,110 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f319d8d6-e323-42ad-9791-56b061daefee
2025-07-21 13:33:35,124 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9fed8441-b91f-4ad1-8512-ffad93a7655a
2025-07-21 13:33:35,151 - INFO - Verified VN network id 18 for VN f319d8d6-e323-42ad-9791-56b061daefee
2025-07-21 13:33:35,151 - INFO - Verifications in API Server for VN ctest-right_vn-96660336 passed
2025-07-21 13:33:35,151 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f319d8d6-e323-42ad-9791-56b061daefee
2025-07-21 13:33:35,167 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9fed8441-b91f-4ad1-8512-ffad93a7655a
2025-07-21 13:33:35,182 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9fed8441-b91f-4ad1-8512-ffad93a7655a
2025-07-21 13:33:35,193 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/70dca082-cbb7-4abe-90bf-37cb08f61f87
2025-07-21 13:33:35,206 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-66955652:ctest-right_vn-96660336', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-66955652', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17517270643079594669', 'uuid-lslong': '10921605886906134510'}, 'enable': 'true', 'created': '2025-07-21T13:33:34', 'last-modified': '2025-07-21T13:33:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.622694'}
2025-07-21 13:33:35,214 - DEBUG - Route Targets: ['target:64512:8000013']
2025-07-21 13:33:35,214 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-96660336 passed
2025-07-21 13:33:35,214 - DEBUG - ====Verifying policy data for ctest-right_vn-96660336 in API_Server ======
2025-07-21 13:33:35,215 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:35,221 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:35,236 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:35,339 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f319d8d6-e323-42ad-9791-56b061daefee
2025-07-21 13:33:35,352 - DEBUG - =>VN ctest-right_vn-96660336 has no policy to be verified
2025-07-21 13:33:35,352 - DEBUG - Verifying the vn in opserver
2025-07-21 13:33:35,352 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66955652:ctest-right_vn-96660336 virtual network link  through opserver 10.0.0.254
2025-07-21 13:33:35,352 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:33:35,365 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-66955652:ctest-right_vn-96660336', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-66955652:ctest-right_vn-96660336?flat'}
2025-07-21 13:33:35,365 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-66955652:ctest-right_vn-96660336 is found in opserver
2025-07-21 13:33:35,382 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:33:35,393 - DEBUG - VRF ids for VN ctest-right_vn-96660336: {}
2025-07-21 13:33:35,690 - DEBUG - Response for create_network : {'network': {'id': 'fd4fc53e-0bf6-4cdc-8506-83b92b804110', 'name': 'ctest-trans_left_vn-89774090', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-66955652', 'ctest-trans_left_vn-89774090'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:33:35,879 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd9fc10a6-8982-4619-b971-1c36dd5ca570', 'name': '', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'network_id': 'fd4fc53e-0bf6-4cdc-8506-83b92b804110', 'ip_version': 4, 'cidr': '2.179.53.64/26', 'allocation_pools': [{'start': '2.179.53.66', 'end': '2.179.53.126'}], 'gateway_ip': '2.179.53.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2.179.53.66', 'tags': [], 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a'}}
2025-07-21 13:33:35,900 - INFO - Created VN ctest-trans_left_vn-89774090
2025-07-21 13:33:35,953 - DEBUG - VN ctest-trans_left_vn-89774090 UUID is fd4fc53e-0bf6-4cdc-8506-83b92b804110
2025-07-21 13:33:36,143 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:36,161 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:36,200 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:36,334 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/fd4fc53e-0bf6-4cdc-8506-83b92b804110
2025-07-21 13:33:36,358 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/fd4fc53e-0bf6-4cdc-8506-83b92b804110
2025-07-21 13:33:36,377 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3b3cb92c-1b6b-44ab-9ac7-231d7db99864
2025-07-21 13:33:36,393 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3b3cb92c-1b6b-44ab-9ac7-231d7db99864
2025-07-21 13:33:36,415 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/89daf146-c490-4d02-b3ed-a2730cfee76d
2025-07-21 13:33:36,433 - DEBUG - Route Targets: ['target:64512:8000014']
2025-07-21 13:33:36,434 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/fd4fc53e-0bf6-4cdc-8506-83b92b804110
2025-07-21 13:33:36,459 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3b3cb92c-1b6b-44ab-9ac7-231d7db99864
2025-07-21 13:33:36,486 - INFO - Verified VN network id 19 for VN fd4fc53e-0bf6-4cdc-8506-83b92b804110
2025-07-21 13:33:36,487 - INFO - Verifications in API Server for VN ctest-trans_left_vn-89774090 passed
2025-07-21 13:33:36,487 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/fd4fc53e-0bf6-4cdc-8506-83b92b804110
2025-07-21 13:33:36,515 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3b3cb92c-1b6b-44ab-9ac7-231d7db99864
2025-07-21 13:33:36,538 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3b3cb92c-1b6b-44ab-9ac7-231d7db99864
2025-07-21 13:33:36,555 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/89daf146-c490-4d02-b3ed-a2730cfee76d
2025-07-21 13:33:36,589 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-66955652:ctest-trans_left_vn-89774090', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-66955652', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18253024685035244764', 'uuid-lslong': '9585493688226693392'}, 'enable': 'true', 'created': '2025-07-21T13:33:35', 'last-modified': '2025-07-21T13:33:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.750497'}
2025-07-21 13:33:36,605 - DEBUG - Route Targets: ['target:64512:8000014']
2025-07-21 13:33:36,605 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-89774090 passed
2025-07-21 13:33:36,605 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-89774090 in API_Server ======
2025-07-21 13:33:36,605 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:36,614 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:36,636 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:36,742 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/fd4fc53e-0bf6-4cdc-8506-83b92b804110
2025-07-21 13:33:36,762 - DEBUG - =>VN ctest-trans_left_vn-89774090 has no policy to be verified
2025-07-21 13:33:36,762 - DEBUG - Verifying the vn in opserver
2025-07-21 13:33:36,762 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66955652:ctest-trans_left_vn-89774090 virtual network link  through opserver 10.0.0.254
2025-07-21 13:33:36,762 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:33:36,788 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-66955652:ctest-trans_left_vn-89774090', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-66955652:ctest-trans_left_vn-89774090?flat'}
2025-07-21 13:33:36,788 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-66955652:ctest-trans_left_vn-89774090 is found in opserver
2025-07-21 13:33:36,810 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:33:36,821 - DEBUG - VRF ids for VN ctest-trans_left_vn-89774090: {}
2025-07-21 13:33:37,071 - DEBUG - Response for create_network : {'network': {'id': '1f026a38-9aa2-4462-9c64-2b9e1e7a4011', 'name': 'ctest-trans_right_vn-77689261', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-66955652', 'ctest-trans_right_vn-77689261'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:33:37,310 - DEBUG - Response for create_subnet : {'subnet': {'id': '3df8df30-b47f-4eee-939c-4f2cd7cad581', 'name': '', 'tenant_id': '5c22cac359ad4121b0a6d47b50d8c35a', 'network_id': '1f026a38-9aa2-4462-9c64-2b9e1e7a4011', 'ip_version': 4, 'cidr': '167.23.118.192/26', 'allocation_pools': [{'start': '167.23.118.194', 'end': '167.23.118.254'}], 'gateway_ip': '167.23.118.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '167.23.118.194', 'tags': [], 'project_id': '5c22cac359ad4121b0a6d47b50d8c35a'}}
2025-07-21 13:33:37,334 - INFO - Created VN ctest-trans_right_vn-77689261
2025-07-21 13:33:37,393 - DEBUG - VN ctest-trans_right_vn-77689261 UUID is 1f026a38-9aa2-4462-9c64-2b9e1e7a4011
2025-07-21 13:33:37,564 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:37,575 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:37,600 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:37,717 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1f026a38-9aa2-4462-9c64-2b9e1e7a4011
2025-07-21 13:33:37,739 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1f026a38-9aa2-4462-9c64-2b9e1e7a4011
2025-07-21 13:33:37,760 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/d1a7766c-7b7e-469e-a1db-b6fdf83eee30
2025-07-21 13:33:37,783 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/d1a7766c-7b7e-469e-a1db-b6fdf83eee30
2025-07-21 13:33:37,805 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/0ecbd73a-1ab4-482c-b633-ecf87d1aacf9
2025-07-21 13:33:37,824 - DEBUG - Route Targets: ['target:64512:8000015']
2025-07-21 13:33:37,824 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1f026a38-9aa2-4462-9c64-2b9e1e7a4011
2025-07-21 13:33:37,847 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/d1a7766c-7b7e-469e-a1db-b6fdf83eee30
2025-07-21 13:33:37,884 - INFO - Verified VN network id 20 for VN 1f026a38-9aa2-4462-9c64-2b9e1e7a4011
2025-07-21 13:33:37,884 - INFO - Verifications in API Server for VN ctest-trans_right_vn-77689261 passed
2025-07-21 13:33:37,885 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1f026a38-9aa2-4462-9c64-2b9e1e7a4011
2025-07-21 13:33:37,907 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/d1a7766c-7b7e-469e-a1db-b6fdf83eee30
2025-07-21 13:33:37,922 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/d1a7766c-7b7e-469e-a1db-b6fdf83eee30
2025-07-21 13:33:37,935 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/0ecbd73a-1ab4-482c-b633-ecf87d1aacf9
2025-07-21 13:33:37,968 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-66955652:ctest-trans_right_vn-77689261', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-66955652', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2234465156474225762', 'uuid-lslong': '11269180125703979025'}, 'enable': 'true', 'created': '2025-07-21T13:33:37', 'last-modified': '2025-07-21T13:33:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.706452'}
2025-07-21 13:33:37,981 - DEBUG - Route Targets: ['target:64512:8000015']
2025-07-21 13:33:37,981 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-77689261 passed
2025-07-21 13:33:37,981 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-77689261 in API_Server ======
2025-07-21 13:33:37,981 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:33:37,994 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:33:38,017 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:33:38,151 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1f026a38-9aa2-4462-9c64-2b9e1e7a4011
2025-07-21 13:33:38,187 - DEBUG - =>VN ctest-trans_right_vn-77689261 has no policy to be verified
2025-07-21 13:33:38,187 - DEBUG - Verifying the vn in opserver
2025-07-21 13:33:38,187 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66955652:ctest-trans_right_vn-77689261 virtual network link  through opserver 10.0.0.254
2025-07-21 13:33:38,188 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:33:38,211 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-66955652:ctest-trans_right_vn-77689261', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-66955652:ctest-trans_right_vn-77689261?flat'}
2025-07-21 13:33:38,212 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-66955652:ctest-trans_right_vn-77689261 is found in opserver
2025-07-21 13:33:38,233 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:33:38,246 - DEBUG - VRF ids for VN ctest-trans_right_vn-77689261: {}
2025-07-21 13:33:39,654 - INFO - VM ([<Server: ctest-left_vm-37589762>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:33:41,019 - INFO - VM ([<Server: ctest-right_vm-86727552>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:33:41,020 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-68882178']
2025-07-21 13:33:41,392 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-68882178'] created succesfully
2025-07-21 13:35:22,474 - DEBUG - Installing image tiny_trans_fw
2025-07-21 13:35:22,474 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-07-21 13:35:22,475 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz
2025-07-21 13:35:22,475 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz
2025-07-21 13:35:22,513 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz -O /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-07-21 13:35:22,567 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-07-21 13:35:22,567 - DEBUG - Unzip image
2025-07-21 13:35:22,568 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-07-21 13:35:22,604 - DEBUG - Try to create image in user context
2025-07-21 13:35:22,723 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-68882178']
2025-07-21 13:35:22,841 - INFO - Service template: ['default-domain', 'ctest-service_template_1-68882178'] deleted successfully.
2025-07-21 13:35:22,842 - INFO - Skip interface_detach for VM ctest-right_vm-86727552 in state BUILD
2025-07-21 13:35:22,842 - INFO - Deleting VM ctest-right_vm-86727552
2025-07-21 13:35:22,842 - ERROR - VM ctest-right_vm-86727552 has failed to come up
2025-07-21 13:35:22,842 - ERROR - Nova failed to get host of the VM
2025-07-21 13:35:23,020 - INFO - Skip interface_detach for VM ctest-left_vm-37589762 in state BUILD
2025-07-21 13:35:23,020 - INFO - Deleting VM ctest-left_vm-37589762
2025-07-21 13:35:23,020 - ERROR - VM ctest-left_vm-37589762 has failed to come up
2025-07-21 13:35:23,021 - ERROR - Nova failed to get host of the VM
2025-07-21 13:35:23,163 - INFO - Deleting VN ctest-trans_right_vn-77689261 
2025-07-21 13:35:23,402 - DEBUG - Response for deleting network ()
2025-07-21 13:35:23,402 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/d1a7766c-7b7e-469e-a1db-b6fdf83eee30
2025-07-21 13:35:23,409 - DEBUG - Response Code: 404
2025-07-21 13:35:23,409 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:35:23,415 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:35:23,483 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:35:23,576 - INFO - Validated that VN ctest-trans_right_vn-77689261 is not found in API Server
2025-07-21 13:35:23,600 - DEBUG - VN ctest-trans_right_vn-77689261 is not present in Agent 10.0.0.254 
2025-07-21 13:35:23,600 - INFO - Validated that VN ctest-trans_right_vn-77689261 is not in any agent
2025-07-21 13:35:23,619 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-77689261 info
2025-07-21 13:35:23,619 - INFO - Deleting VN ctest-trans_left_vn-89774090 
2025-07-21 13:35:23,772 - DEBUG - Response for deleting network ()
2025-07-21 13:35:23,772 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3b3cb92c-1b6b-44ab-9ac7-231d7db99864
2025-07-21 13:35:23,778 - DEBUG - Response Code: 404
2025-07-21 13:35:23,778 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:35:23,787 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:35:23,848 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:35:23,927 - INFO - Validated that VN ctest-trans_left_vn-89774090 is not found in API Server
2025-07-21 13:35:23,940 - DEBUG - VN ctest-trans_left_vn-89774090 is not present in Agent 10.0.0.254 
2025-07-21 13:35:23,940 - INFO - Validated that VN ctest-trans_left_vn-89774090 is not in any agent
2025-07-21 13:35:23,959 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-89774090 info
2025-07-21 13:35:23,959 - INFO - Deleting VN ctest-right_vn-96660336 
2025-07-21 13:35:24,065 - DEBUG - Response for deleting network ()
2025-07-21 13:35:24,065 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9fed8441-b91f-4ad1-8512-ffad93a7655a
2025-07-21 13:35:24,071 - DEBUG - Response Code: 404
2025-07-21 13:35:24,072 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:35:24,078 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:35:24,135 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:35:24,241 - INFO - Validated that VN ctest-right_vn-96660336 is not found in API Server
2025-07-21 13:35:24,270 - DEBUG - VN ctest-right_vn-96660336 is not present in Agent 10.0.0.254 
2025-07-21 13:35:24,270 - INFO - Validated that VN ctest-right_vn-96660336 is not in any agent
2025-07-21 13:35:24,297 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-96660336 info
2025-07-21 13:35:24,297 - INFO - Deleting VN ctest-left_vn-39844670 
2025-07-21 13:35:24,427 - DEBUG - Response for deleting network ()
2025-07-21 13:35:24,427 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a9a61673-7f64-4b2c-af61-44c3f0a350d4
2025-07-21 13:35:24,432 - DEBUG - Response Code: 404
2025-07-21 13:35:24,432 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:35:24,437 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:35:24,494 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:35:24,593 - INFO - Validated that VN ctest-left_vn-39844670 is not found in API Server
2025-07-21 13:35:24,610 - DEBUG - VN ctest-left_vn-39844670 is not present in Agent 10.0.0.254 
2025-07-21 13:35:24,610 - INFO - Validated that VN ctest-left_vn-39844670 is not in any agent
2025-07-21 13:35:24,637 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-39844670 info
2025-07-21 13:35:24,637 - INFO - Deleting VN ctest-mgmt_vn-26209858 
2025-07-21 13:35:24,811 - DEBUG - Response for deleting network ()
2025-07-21 13:35:24,811 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c1077776-50e3-4682-9138-7db53b9e42d7
2025-07-21 13:35:24,819 - DEBUG - Response Code: 404
2025-07-21 13:35:24,819 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:35:24,826 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:35:24,894 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c22cac3-59ad-4121-b0a6-d47b50d8c35a
2025-07-21 13:35:25,008 - INFO - Validated that VN ctest-mgmt_vn-26209858 is not found in API Server
2025-07-21 13:35:25,042 - DEBUG - VN ctest-mgmt_vn-26209858 is not present in Agent 10.0.0.254 
2025-07-21 13:35:25,042 - INFO - Validated that VN ctest-mgmt_vn-26209858 is not in any agent
2025-07-21 13:35:25,077 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-26209858 info
2025-07-21 13:35:25,392 - ERROR - <pre>Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/tcutils/util.py", line 1041, in wrapper
    return f(self, *func_args, **func_kwargs)
  File "/contrail-test/scripts/svc_firewall/test_svc_fw.py", line 34, in test_svc_v2_transparent_datapath
    create_svms=True)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-net-transparent-fw.qcow2'
</pre>

2025-07-21 13:35:25,415 - DEBUG - No XMPP flaps were noticed during the test
2025-07-21 13:35:25,415 - INFO - 
2025-07-21 13:35:25,415 - INFO - END TEST : test_svc_v2_transparent_datapath : FAILED[0:01:55]
2025-07-21 13:35:25,415 - INFO - --------------------------------------------------------------------------------
2025-07-21 13:35:26,405 - INFO - Deleted project: ctest-TestSvcRegr-66955652, ID : 5c22cac3-59ad-4121-b0a6-d47b50d8c35a 
2025-07-21 13:35:26,757 - INFO - Domain Default found not creating
2025-07-21 13:35:27,102 - INFO - Project ctest-TestSvcRegr-49246486 not found, creating it
2025-07-21 13:35:27,807 - INFO - Created Project:ctest-TestSvcRegr-49246486, ID : 9ec4c24f-6cef-4136-b80d-537c048d255d 
2025-07-21 13:35:30,083 - INFO - ================================================================================
2025-07-21 13:35:30,083 - INFO - STARTING TEST    : test_svc_CEM_22032
2025-07-21 13:35:30,400 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with
2025-07-21 13:35:30,401 - INFO - Initial checks done. Running the testcase now
2025-07-21 13:35:30,401 - INFO - 
2025-07-21 13:35:31,306 - DEBUG - Response for create_network : {'network': {'id': 'ca6c750f-3b78-4c91-9649-85378495d9c5', 'name': 'ctest-mgmt_vn-89309265', 'tenant_id': '9ec4c24f6cef4136b80d537c048d255d', 'project_id': '9ec4c24f6cef4136b80d537c048d255d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-49246486', 'ctest-mgmt_vn-89309265'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:35:31,594 - DEBUG - Response for create_subnet : {'subnet': {'id': '7f6f882c-ca37-4b1b-ab04-dfdd8f7b6fa8', 'name': '', 'tenant_id': '9ec4c24f6cef4136b80d537c048d255d', 'network_id': 'ca6c750f-3b78-4c91-9649-85378495d9c5', 'ip_version': 4, 'cidr': '12.229.167.128/26', 'allocation_pools': [{'start': '12.229.167.130', 'end': '12.229.167.190'}], 'gateway_ip': '12.229.167.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '12.229.167.130', 'tags': [], 'project_id': '9ec4c24f6cef4136b80d537c048d255d'}}
2025-07-21 13:35:31,623 - INFO - Created VN ctest-mgmt_vn-89309265
2025-07-21 13:35:31,676 - DEBUG - VN ctest-mgmt_vn-89309265 UUID is ca6c750f-3b78-4c91-9649-85378495d9c5
2025-07-21 13:35:31,802 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:35:32,117 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:35:32,198 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:35:32,243 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:35:32,348 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ca6c750f-3b78-4c91-9649-85378495d9c5
2025-07-21 13:35:32,388 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ca6c750f-3b78-4c91-9649-85378495d9c5
2025-07-21 13:35:32,421 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/96a7d1c8-eac3-4838-aff0-e7c57cbe5b48
2025-07-21 13:35:32,448 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/96a7d1c8-eac3-4838-aff0-e7c57cbe5b48
2025-07-21 13:35:32,472 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/6d2d21e3-2ef4-462d-8ee3-40744018d7e0
2025-07-21 13:35:32,489 - DEBUG - Route Targets: ['target:64512:8000011']
2025-07-21 13:35:32,489 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ca6c750f-3b78-4c91-9649-85378495d9c5
2025-07-21 13:35:32,517 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/96a7d1c8-eac3-4838-aff0-e7c57cbe5b48
2025-07-21 13:35:32,557 - INFO - Verified VN network id 16 for VN ca6c750f-3b78-4c91-9649-85378495d9c5
2025-07-21 13:35:32,557 - INFO - Verifications in API Server for VN ctest-mgmt_vn-89309265 passed
2025-07-21 13:35:32,557 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ca6c750f-3b78-4c91-9649-85378495d9c5
2025-07-21 13:35:32,582 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/96a7d1c8-eac3-4838-aff0-e7c57cbe5b48
2025-07-21 13:35:32,600 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/96a7d1c8-eac3-4838-aff0-e7c57cbe5b48
2025-07-21 13:35:32,615 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/6d2d21e3-2ef4-462d-8ee3-40744018d7e0
2025-07-21 13:35:32,645 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49246486:ctest-mgmt_vn-89309265', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49246486', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14586162001428892817', 'uuid-lslong': '10829333252483176901'}, 'enable': 'true', 'created': '2025-07-21T13:35:31', 'last-modified': '2025-07-21T13:35:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.129506'}
2025-07-21 13:35:32,653 - DEBUG - Route Targets: ['target:64512:8000011']
2025-07-21 13:35:32,653 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-89309265 passed
2025-07-21 13:35:32,654 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-89309265 in API_Server ======
2025-07-21 13:35:32,654 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:35:32,665 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:35:32,702 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:35:32,826 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ca6c750f-3b78-4c91-9649-85378495d9c5
2025-07-21 13:35:32,851 - DEBUG - =>VN ctest-mgmt_vn-89309265 has no policy to be verified
2025-07-21 13:35:32,851 - DEBUG - Verifying the vn in opserver
2025-07-21 13:35:32,851 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49246486:ctest-mgmt_vn-89309265 virtual network link  through opserver 10.0.0.254
2025-07-21 13:35:32,852 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:35:33,203 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:35:33,308 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49246486:ctest-mgmt_vn-89309265', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49246486:ctest-mgmt_vn-89309265?flat'}
2025-07-21 13:35:33,309 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-49246486:ctest-mgmt_vn-89309265 is found in opserver
2025-07-21 13:35:33,342 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:35:33,353 - DEBUG - VRF ids for VN ctest-mgmt_vn-89309265: {}
2025-07-21 13:35:33,743 - DEBUG - Response for create_network : {'network': {'id': '7afe57bb-ca4d-4d22-8d65-abbc76239596', 'name': 'service-left-vn-86302748', 'tenant_id': '9ec4c24f6cef4136b80d537c048d255d', 'project_id': '9ec4c24f6cef4136b80d537c048d255d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-49246486', 'service-left-vn-86302748'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:35:34,012 - DEBUG - Response for create_subnet : {'subnet': {'id': '597ce901-5ba8-4da4-ace1-847e0b05e2c1', 'name': '', 'tenant_id': '9ec4c24f6cef4136b80d537c048d255d', 'network_id': '7afe57bb-ca4d-4d22-8d65-abbc76239596', 'ip_version': 4, 'cidr': '149.134.93.0/26', 'allocation_pools': [{'start': '149.134.93.2', 'end': '149.134.93.62'}], 'gateway_ip': '149.134.93.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '149.134.93.2', 'tags': [], 'project_id': '9ec4c24f6cef4136b80d537c048d255d'}}
2025-07-21 13:35:34,042 - INFO - Created VN service-left-vn-86302748
2025-07-21 13:35:34,101 - DEBUG - VN service-left-vn-86302748 UUID is 7afe57bb-ca4d-4d22-8d65-abbc76239596
2025-07-21 13:35:34,281 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:35:34,296 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:35:34,327 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:35:34,448 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7afe57bb-ca4d-4d22-8d65-abbc76239596
2025-07-21 13:35:34,475 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7afe57bb-ca4d-4d22-8d65-abbc76239596
2025-07-21 13:35:34,507 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b6309fb5-093d-4887-aa9e-f22a9451cc48
2025-07-21 13:35:34,531 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b6309fb5-093d-4887-aa9e-f22a9451cc48
2025-07-21 13:35:34,555 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/42e0c094-4b83-4467-918a-5f1d8051fb49
2025-07-21 13:35:34,576 - DEBUG - Route Targets: ['target:64512:8000012']
2025-07-21 13:35:34,576 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7afe57bb-ca4d-4d22-8d65-abbc76239596
2025-07-21 13:35:34,605 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b6309fb5-093d-4887-aa9e-f22a9451cc48
2025-07-21 13:35:34,655 - INFO - Verified VN network id 17 for VN 7afe57bb-ca4d-4d22-8d65-abbc76239596
2025-07-21 13:35:34,655 - INFO - Verifications in API Server for VN service-left-vn-86302748 passed
2025-07-21 13:35:34,655 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7afe57bb-ca4d-4d22-8d65-abbc76239596
2025-07-21 13:35:34,678 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b6309fb5-093d-4887-aa9e-f22a9451cc48
2025-07-21 13:35:34,696 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b6309fb5-093d-4887-aa9e-f22a9451cc48
2025-07-21 13:35:34,717 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/42e0c094-4b83-4467-918a-5f1d8051fb49
2025-07-21 13:35:34,757 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49246486:service-left-vn-86302748', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49246486', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8862617580776279330', 'uuid-lslong': '10188738557919860118'}, 'enable': 'true', 'created': '2025-07-21T13:35:33', 'last-modified': '2025-07-21T13:35:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.808004'}
2025-07-21 13:35:34,778 - DEBUG - Route Targets: ['target:64512:8000012']
2025-07-21 13:35:34,779 - INFO - On all control nodes, Config, RI and RT verification for VN service-left-vn-86302748 passed
2025-07-21 13:35:34,779 - DEBUG - ====Verifying policy data for service-left-vn-86302748 in API_Server ======
2025-07-21 13:35:34,780 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:35:34,799 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:35:34,842 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:35:34,975 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7afe57bb-ca4d-4d22-8d65-abbc76239596
2025-07-21 13:35:35,001 - DEBUG - =>VN service-left-vn-86302748 has no policy to be verified
2025-07-21 13:35:35,001 - DEBUG - Verifying the vn in opserver
2025-07-21 13:35:35,001 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49246486:service-left-vn-86302748 virtual network link  through opserver 10.0.0.254
2025-07-21 13:35:35,002 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:35:35,030 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49246486:service-left-vn-86302748', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49246486:service-left-vn-86302748?flat'}
2025-07-21 13:35:35,030 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-49246486:service-left-vn-86302748 is found in opserver
2025-07-21 13:35:35,061 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:35:35,073 - DEBUG - VRF ids for VN service-left-vn-86302748: {}
2025-07-21 13:35:35,496 - DEBUG - Response for create_network : {'network': {'id': '490f5d67-1f1e-49f9-a3fd-7b05a6a01e16', 'name': 'service-right-vn-62064759', 'tenant_id': '9ec4c24f6cef4136b80d537c048d255d', 'project_id': '9ec4c24f6cef4136b80d537c048d255d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-49246486', 'service-right-vn-62064759'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:35:35,679 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b1f5de9f-8d2d-43d3-80be-80cad6282f89', 'name': '', 'tenant_id': '9ec4c24f6cef4136b80d537c048d255d', 'network_id': '490f5d67-1f1e-49f9-a3fd-7b05a6a01e16', 'ip_version': 4, 'cidr': '223.23.8.192/26', 'allocation_pools': [{'start': '223.23.8.194', 'end': '223.23.8.254'}], 'gateway_ip': '223.23.8.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '223.23.8.194', 'tags': [], 'project_id': '9ec4c24f6cef4136b80d537c048d255d'}}
2025-07-21 13:35:35,700 - INFO - Created VN service-right-vn-62064759
2025-07-21 13:35:35,753 - DEBUG - VN service-right-vn-62064759 UUID is 490f5d67-1f1e-49f9-a3fd-7b05a6a01e16
2025-07-21 13:35:35,951 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:35:35,962 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:35:35,988 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:35:36,086 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/490f5d67-1f1e-49f9-a3fd-7b05a6a01e16
2025-07-21 13:35:36,107 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/490f5d67-1f1e-49f9-a3fd-7b05a6a01e16
2025-07-21 13:35:36,125 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ec8d1317-a825-4484-9638-a7f556885e41
2025-07-21 13:35:36,140 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ec8d1317-a825-4484-9638-a7f556885e41
2025-07-21 13:35:36,156 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/0d04dd92-2cd9-4002-aa61-e343d9c261ad
2025-07-21 13:35:36,172 - DEBUG - Route Targets: ['target:64512:8000013']
2025-07-21 13:35:36,172 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/490f5d67-1f1e-49f9-a3fd-7b05a6a01e16
2025-07-21 13:35:36,196 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ec8d1317-a825-4484-9638-a7f556885e41
2025-07-21 13:35:36,239 - INFO - Verified VN network id 18 for VN 490f5d67-1f1e-49f9-a3fd-7b05a6a01e16
2025-07-21 13:35:36,239 - INFO - Verifications in API Server for VN service-right-vn-62064759 passed
2025-07-21 13:35:36,239 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/490f5d67-1f1e-49f9-a3fd-7b05a6a01e16
2025-07-21 13:35:36,265 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ec8d1317-a825-4484-9638-a7f556885e41
2025-07-21 13:35:36,285 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ec8d1317-a825-4484-9638-a7f556885e41
2025-07-21 13:35:36,307 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/0d04dd92-2cd9-4002-aa61-e343d9c261ad
2025-07-21 13:35:36,349 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49246486:service-right-vn-62064759', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49246486', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5264529186904492537', 'uuid-lslong': '11816736261490613782'}, 'enable': 'true', 'created': '2025-07-21T13:35:35', 'last-modified': '2025-07-21T13:35:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.710274'}
2025-07-21 13:35:36,374 - DEBUG - Route Targets: ['target:64512:8000013']
2025-07-21 13:35:36,374 - INFO - On all control nodes, Config, RI and RT verification for VN service-right-vn-62064759 passed
2025-07-21 13:35:36,375 - DEBUG - ====Verifying policy data for service-right-vn-62064759 in API_Server ======
2025-07-21 13:35:36,375 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:35:36,392 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:35:36,434 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:35:36,572 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/490f5d67-1f1e-49f9-a3fd-7b05a6a01e16
2025-07-21 13:35:36,599 - DEBUG - =>VN service-right-vn-62064759 has no policy to be verified
2025-07-21 13:35:36,600 - DEBUG - Verifying the vn in opserver
2025-07-21 13:35:36,600 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49246486:service-right-vn-62064759 virtual network link  through opserver 10.0.0.254
2025-07-21 13:35:36,600 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:35:36,634 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49246486:service-right-vn-62064759', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49246486:service-right-vn-62064759?flat'}
2025-07-21 13:35:36,635 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-49246486:service-right-vn-62064759 is found in opserver
2025-07-21 13:35:36,670 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:35:36,687 - DEBUG - VRF ids for VN service-right-vn-62064759: {}
2025-07-21 13:35:36,863 - DEBUG - Services list from nova: [<Service: 1>, <Service: 1>, <Service: 2>]
2025-07-21 13:35:38,764 - INFO - VM ([<Server: ctest-left_vm-63003429>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:35:40,314 - INFO - VM ([<Server: ctest-right_vm-10710090>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:35:40,314 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-68323928']
2025-07-21 13:35:40,728 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-68323928'] created succesfully
2025-07-21 13:37:21,821 - DEBUG - Installing image tiny_nat_fw
2025-07-21 13:37:21,822 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmtx', 'vcname': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmdk', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-07-21 13:37:21,822 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-21 13:37:21,823 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-21 13:37:21,823 - DEBUG - Unzip image
2025-07-21 13:37:21,823 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-21 13:37:21,863 - DEBUG - Try to create image in user context
2025-07-21 13:37:22,053 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-68323928']
2025-07-21 13:37:22,177 - INFO - Service template: ['default-domain', 'ctest-service_template_1-68323928'] deleted successfully.
2025-07-21 13:37:22,177 - INFO - Skip interface_detach for VM ctest-right_vm-10710090 in state BUILD
2025-07-21 13:37:22,177 - INFO - Deleting VM ctest-right_vm-10710090
2025-07-21 13:37:22,231 - ERROR - VM ctest-right_vm-10710090 has failed to come up
2025-07-21 13:37:22,231 - ERROR - Nova failed to get host of the VM
2025-07-21 13:37:22,400 - INFO - Skip interface_detach for VM ctest-left_vm-63003429 in state BUILD
2025-07-21 13:37:22,401 - INFO - Deleting VM ctest-left_vm-63003429
2025-07-21 13:37:22,401 - ERROR - VM ctest-left_vm-63003429 has failed to come up
2025-07-21 13:37:22,401 - ERROR - Nova failed to get host of the VM
2025-07-21 13:37:22,567 - INFO - Deleting VN service-right-vn-62064759 
2025-07-21 13:37:22,679 - DEBUG - VN 490f5d67-1f1e-49f9-a3fd-7b05a6a01e16 still in use: Unable to complete operation on network 490f5d67-1f1e-49f9-a3fd-7b05a6a01e16. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-8ca9a1c6-0ca1-445d-8ba8-52688fafe50d']
2025-07-21 13:37:22,679 - WARNING - Deleting VN service-right-vn-62064759 failed..Will retry
2025-07-21 13:37:24,927 - DEBUG - Response for deleting network ()
2025-07-21 13:37:24,927 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ec8d1317-a825-4484-9638-a7f556885e41
2025-07-21 13:37:24,934 - DEBUG - Response Code: 404
2025-07-21 13:37:24,934 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:37:24,946 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:37:25,021 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:37:25,154 - INFO - Validated that VN service-right-vn-62064759 is not found in API Server
2025-07-21 13:37:25,192 - DEBUG - VN service-right-vn-62064759 is not present in Agent 10.0.0.254 
2025-07-21 13:37:25,193 - INFO - Validated that VN service-right-vn-62064759 is not in any agent
2025-07-21 13:37:25,256 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-right-vn-62064759 info
2025-07-21 13:37:25,256 - INFO - Deleting VN service-left-vn-86302748 
2025-07-21 13:37:25,534 - DEBUG - Response for deleting network ()
2025-07-21 13:37:25,534 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b6309fb5-093d-4887-aa9e-f22a9451cc48
2025-07-21 13:37:25,549 - DEBUG - Response Code: 404
2025-07-21 13:37:25,551 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:37:25,563 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:37:25,588 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:37:25,692 - INFO - Validated that VN service-left-vn-86302748 is not found in API Server
2025-07-21 13:37:25,712 - DEBUG - VN service-left-vn-86302748 is not present in Agent 10.0.0.254 
2025-07-21 13:37:25,712 - INFO - Validated that VN service-left-vn-86302748 is not in any agent
2025-07-21 13:37:25,754 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-left-vn-86302748 info
2025-07-21 13:37:25,755 - INFO - Deleting VN ctest-mgmt_vn-89309265 
2025-07-21 13:37:26,009 - DEBUG - Response for deleting network ()
2025-07-21 13:37:26,009 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/96a7d1c8-eac3-4838-aff0-e7c57cbe5b48
2025-07-21 13:37:26,023 - DEBUG - Response Code: 404
2025-07-21 13:37:26,023 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:37:26,031 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:37:26,049 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:37:26,162 - INFO - Validated that VN ctest-mgmt_vn-89309265 is not found in API Server
2025-07-21 13:37:26,187 - DEBUG - VN ctest-mgmt_vn-89309265 is not present in Agent 10.0.0.254 
2025-07-21 13:37:26,188 - INFO - Validated that VN ctest-mgmt_vn-89309265 is not in any agent
2025-07-21 13:37:26,238 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-89309265 info
2025-07-21 13:37:26,552 - ERROR - <pre>Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_firewall/test_svc_fw_basic.py", line 35, in test_svc_CEM_22032
    right_vn_name=get_random_name('service-right-vn', ''))
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network-nat.qcow2'
</pre>

2025-07-21 13:37:26,571 - DEBUG - No XMPP flaps were noticed during the test
2025-07-21 13:37:26,571 - INFO - 
2025-07-21 13:37:26,572 - INFO - END TEST : test_svc_CEM_22032 : FAILED[0:01:56]
2025-07-21 13:37:26,572 - INFO - --------------------------------------------------------------------------------
2025-07-21 13:37:26,583 - INFO - ================================================================================
2025-07-21 13:37:26,583 - INFO - STARTING TEST    : test_svc_in_network_datapath
2025-07-21 13:37:26,923 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with
2025-07-21 13:37:26,923 - INFO - Initial checks done. Running the testcase now
2025-07-21 13:37:26,923 - INFO - 
2025-07-21 13:37:27,362 - DEBUG - Response for create_network : {'network': {'id': '6b3e0901-835e-41f2-a24b-e82181dca553', 'name': 'ctest-mgmt_vn-92060587', 'tenant_id': '9ec4c24f6cef4136b80d537c048d255d', 'project_id': '9ec4c24f6cef4136b80d537c048d255d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-49246486', 'ctest-mgmt_vn-92060587'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:37:27,573 - DEBUG - Response for create_subnet : {'subnet': {'id': '915a2477-4483-47c2-9742-0065b8f55b86', 'name': '', 'tenant_id': '9ec4c24f6cef4136b80d537c048d255d', 'network_id': '6b3e0901-835e-41f2-a24b-e82181dca553', 'ip_version': 4, 'cidr': '95.137.215.128/26', 'allocation_pools': [{'start': '95.137.215.130', 'end': '95.137.215.190'}], 'gateway_ip': '95.137.215.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '95.137.215.130', 'tags': [], 'project_id': '9ec4c24f6cef4136b80d537c048d255d'}}
2025-07-21 13:37:27,605 - INFO - Created VN ctest-mgmt_vn-92060587
2025-07-21 13:37:27,670 - DEBUG - VN ctest-mgmt_vn-92060587 UUID is 6b3e0901-835e-41f2-a24b-e82181dca553
2025-07-21 13:37:27,865 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:37:27,878 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:37:27,925 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:37:28,024 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6b3e0901-835e-41f2-a24b-e82181dca553
2025-07-21 13:37:28,062 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6b3e0901-835e-41f2-a24b-e82181dca553
2025-07-21 13:37:28,098 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ab4ef658-b31b-4a88-a653-15684bd8c85e
2025-07-21 13:37:28,123 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ab4ef658-b31b-4a88-a653-15684bd8c85e
2025-07-21 13:37:28,146 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/7e635a34-5f94-4a37-87ec-866c17f378c0
2025-07-21 13:37:28,169 - DEBUG - Route Targets: ['target:64512:8000011']
2025-07-21 13:37:28,170 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6b3e0901-835e-41f2-a24b-e82181dca553
2025-07-21 13:37:28,197 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ab4ef658-b31b-4a88-a653-15684bd8c85e
2025-07-21 13:37:28,238 - INFO - Verified VN network id 16 for VN 6b3e0901-835e-41f2-a24b-e82181dca553
2025-07-21 13:37:28,238 - INFO - Verifications in API Server for VN ctest-mgmt_vn-92060587 passed
2025-07-21 13:37:28,238 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6b3e0901-835e-41f2-a24b-e82181dca553
2025-07-21 13:37:28,277 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ab4ef658-b31b-4a88-a653-15684bd8c85e
2025-07-21 13:37:28,300 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ab4ef658-b31b-4a88-a653-15684bd8c85e
2025-07-21 13:37:28,325 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/7e635a34-5f94-4a37-87ec-866c17f378c0
2025-07-21 13:37:28,372 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49246486:ctest-mgmt_vn-92060587', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49246486', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7727623912717959666', 'uuid-lslong': '11694696088007910739'}, 'enable': 'true', 'created': '2025-07-21T13:37:27', 'last-modified': '2025-07-21T13:37:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.847401'}
2025-07-21 13:37:28,394 - DEBUG - Route Targets: ['target:64512:8000011']
2025-07-21 13:37:28,394 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-92060587 passed
2025-07-21 13:37:28,395 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-92060587 in API_Server ======
2025-07-21 13:37:28,395 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:37:28,412 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:37:28,457 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:37:28,545 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6b3e0901-835e-41f2-a24b-e82181dca553
2025-07-21 13:37:28,567 - DEBUG - =>VN ctest-mgmt_vn-92060587 has no policy to be verified
2025-07-21 13:37:28,567 - DEBUG - Verifying the vn in opserver
2025-07-21 13:37:28,567 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49246486:ctest-mgmt_vn-92060587 virtual network link  through opserver 10.0.0.254
2025-07-21 13:37:28,567 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:37:28,590 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49246486:ctest-mgmt_vn-92060587', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49246486:ctest-mgmt_vn-92060587?flat'}
2025-07-21 13:37:28,590 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-49246486:ctest-mgmt_vn-92060587 is found in opserver
2025-07-21 13:37:28,612 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:37:28,628 - DEBUG - VRF ids for VN ctest-mgmt_vn-92060587: {}
2025-07-21 13:37:29,018 - DEBUG - Response for create_network : {'network': {'id': 'd3c0c7c4-177f-4273-9c8e-e770aa284997', 'name': 'ctest-left_vn-79330360', 'tenant_id': '9ec4c24f6cef4136b80d537c048d255d', 'project_id': '9ec4c24f6cef4136b80d537c048d255d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-49246486', 'ctest-left_vn-79330360'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:37:29,303 - DEBUG - Response for create_subnet : {'subnet': {'id': 'eeb72e34-d2e0-4bf1-99c9-e5ccf53517c2', 'name': '', 'tenant_id': '9ec4c24f6cef4136b80d537c048d255d', 'network_id': 'd3c0c7c4-177f-4273-9c8e-e770aa284997', 'ip_version': 4, 'cidr': '53.117.222.192/26', 'allocation_pools': [{'start': '53.117.222.194', 'end': '53.117.222.254'}], 'gateway_ip': '53.117.222.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '53.117.222.194', 'tags': [], 'project_id': '9ec4c24f6cef4136b80d537c048d255d'}}
2025-07-21 13:37:29,340 - INFO - Created VN ctest-left_vn-79330360
2025-07-21 13:37:29,413 - DEBUG - VN ctest-left_vn-79330360 UUID is d3c0c7c4-177f-4273-9c8e-e770aa284997
2025-07-21 13:37:29,593 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:37:29,613 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:37:29,648 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:37:29,794 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d3c0c7c4-177f-4273-9c8e-e770aa284997
2025-07-21 13:37:29,834 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d3c0c7c4-177f-4273-9c8e-e770aa284997
2025-07-21 13:37:29,863 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/93d1642c-ee31-432e-8f59-3108f0da2212
2025-07-21 13:37:29,879 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/93d1642c-ee31-432e-8f59-3108f0da2212
2025-07-21 13:37:29,894 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/c01d40fd-b1cb-4b07-beca-8d6aa6c81b5a
2025-07-21 13:37:29,916 - DEBUG - Route Targets: ['target:64512:8000012']
2025-07-21 13:37:29,916 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d3c0c7c4-177f-4273-9c8e-e770aa284997
2025-07-21 13:37:29,934 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/93d1642c-ee31-432e-8f59-3108f0da2212
2025-07-21 13:37:29,960 - INFO - Verified VN network id 17 for VN d3c0c7c4-177f-4273-9c8e-e770aa284997
2025-07-21 13:37:29,960 - INFO - Verifications in API Server for VN ctest-left_vn-79330360 passed
2025-07-21 13:37:29,961 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d3c0c7c4-177f-4273-9c8e-e770aa284997
2025-07-21 13:37:29,981 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/93d1642c-ee31-432e-8f59-3108f0da2212
2025-07-21 13:37:29,996 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/93d1642c-ee31-432e-8f59-3108f0da2212
2025-07-21 13:37:30,011 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/c01d40fd-b1cb-4b07-beca-8d6aa6c81b5a
2025-07-21 13:37:30,035 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49246486:ctest-left_vn-79330360', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49246486', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15258415182552973939', 'uuid-lslong': '11281208587686791575'}, 'enable': 'true', 'created': '2025-07-21T13:37:28', 'last-modified': '2025-07-21T13:37:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.789891'}
2025-07-21 13:37:30,046 - DEBUG - Route Targets: ['target:64512:8000012']
2025-07-21 13:37:30,047 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-79330360 passed
2025-07-21 13:37:30,047 - DEBUG - ====Verifying policy data for ctest-left_vn-79330360 in API_Server ======
2025-07-21 13:37:30,047 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:37:30,060 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:37:30,081 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:37:30,192 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d3c0c7c4-177f-4273-9c8e-e770aa284997
2025-07-21 13:37:30,213 - DEBUG - =>VN ctest-left_vn-79330360 has no policy to be verified
2025-07-21 13:37:30,213 - DEBUG - Verifying the vn in opserver
2025-07-21 13:37:30,213 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49246486:ctest-left_vn-79330360 virtual network link  through opserver 10.0.0.254
2025-07-21 13:37:30,213 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:37:30,236 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49246486:ctest-left_vn-79330360', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49246486:ctest-left_vn-79330360?flat'}
2025-07-21 13:37:30,236 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-49246486:ctest-left_vn-79330360 is found in opserver
2025-07-21 13:37:30,260 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:37:30,269 - DEBUG - VRF ids for VN ctest-left_vn-79330360: {}
2025-07-21 13:37:30,568 - DEBUG - Response for create_network : {'network': {'id': 'db41f92a-5b17-4c0c-95a1-825b165576b2', 'name': 'ctest-right_vn-32068269', 'tenant_id': '9ec4c24f6cef4136b80d537c048d255d', 'project_id': '9ec4c24f6cef4136b80d537c048d255d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-49246486', 'ctest-right_vn-32068269'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:37:30,803 - DEBUG - Response for create_subnet : {'subnet': {'id': 'aca11519-f67c-441f-b550-084022cdf20b', 'name': '', 'tenant_id': '9ec4c24f6cef4136b80d537c048d255d', 'network_id': 'db41f92a-5b17-4c0c-95a1-825b165576b2', 'ip_version': 4, 'cidr': '40.20.52.64/26', 'allocation_pools': [{'start': '40.20.52.66', 'end': '40.20.52.126'}], 'gateway_ip': '40.20.52.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '40.20.52.66', 'tags': [], 'project_id': '9ec4c24f6cef4136b80d537c048d255d'}}
2025-07-21 13:37:30,851 - INFO - Created VN ctest-right_vn-32068269
2025-07-21 13:37:30,925 - DEBUG - VN ctest-right_vn-32068269 UUID is db41f92a-5b17-4c0c-95a1-825b165576b2
2025-07-21 13:37:31,041 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:37:31,051 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:37:31,071 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:37:31,190 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/db41f92a-5b17-4c0c-95a1-825b165576b2
2025-07-21 13:37:31,210 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/db41f92a-5b17-4c0c-95a1-825b165576b2
2025-07-21 13:37:31,229 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/61557775-cf88-40cf-8941-f9d25e15e70c
2025-07-21 13:37:31,243 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/61557775-cf88-40cf-8941-f9d25e15e70c
2025-07-21 13:37:31,258 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/271aca52-b288-42af-ba7b-6d51d5b0cbb8
2025-07-21 13:37:31,273 - DEBUG - Route Targets: ['target:64512:8000013']
2025-07-21 13:37:31,273 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/db41f92a-5b17-4c0c-95a1-825b165576b2
2025-07-21 13:37:31,298 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/61557775-cf88-40cf-8941-f9d25e15e70c
2025-07-21 13:37:31,339 - INFO - Verified VN network id 18 for VN db41f92a-5b17-4c0c-95a1-825b165576b2
2025-07-21 13:37:31,340 - INFO - Verifications in API Server for VN ctest-right_vn-32068269 passed
2025-07-21 13:37:31,340 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/db41f92a-5b17-4c0c-95a1-825b165576b2
2025-07-21 13:37:31,363 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/61557775-cf88-40cf-8941-f9d25e15e70c
2025-07-21 13:37:31,385 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/61557775-cf88-40cf-8941-f9d25e15e70c
2025-07-21 13:37:31,407 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/271aca52-b288-42af-ba7b-6d51d5b0cbb8
2025-07-21 13:37:31,443 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49246486:ctest-right_vn-32068269', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49246486', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15799182928104606732', 'uuid-lslong': '10782042310630012594'}, 'enable': 'true', 'created': '2025-07-21T13:37:30', 'last-modified': '2025-07-21T13:37:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.693033'}
2025-07-21 13:37:31,460 - DEBUG - Route Targets: ['target:64512:8000013']
2025-07-21 13:37:31,460 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-32068269 passed
2025-07-21 13:37:31,461 - DEBUG - ====Verifying policy data for ctest-right_vn-32068269 in API_Server ======
2025-07-21 13:37:31,461 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:37:31,477 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:37:31,498 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:37:31,631 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/db41f92a-5b17-4c0c-95a1-825b165576b2
2025-07-21 13:37:31,656 - DEBUG - =>VN ctest-right_vn-32068269 has no policy to be verified
2025-07-21 13:37:31,656 - DEBUG - Verifying the vn in opserver
2025-07-21 13:37:31,656 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49246486:ctest-right_vn-32068269 virtual network link  through opserver 10.0.0.254
2025-07-21 13:37:31,656 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:37:31,689 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49246486:ctest-right_vn-32068269', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49246486:ctest-right_vn-32068269?flat'}
2025-07-21 13:37:31,690 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-49246486:ctest-right_vn-32068269 is found in opserver
2025-07-21 13:37:31,715 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:37:31,731 - DEBUG - VRF ids for VN ctest-right_vn-32068269: {}
2025-07-21 13:37:33,722 - INFO - VM ([<Server: ctest-left_vm-14171254>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:37:35,436 - INFO - VM ([<Server: ctest-right_vm-63253500>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:37:35,436 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-83285771']
2025-07-21 13:37:35,828 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-83285771'] created succesfully
2025-07-21 13:39:16,821 - DEBUG - Installing image tiny_nat_fw
2025-07-21 13:39:16,822 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmtx', 'vcname': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmdk', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-07-21 13:39:16,823 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-21 13:39:16,823 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-21 13:39:16,824 - DEBUG - Unzip image
2025-07-21 13:39:16,824 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-21 13:39:16,859 - DEBUG - Try to create image in user context
2025-07-21 13:39:17,029 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-83285771']
2025-07-21 13:39:17,157 - INFO - Service template: ['default-domain', 'ctest-service_template_1-83285771'] deleted successfully.
2025-07-21 13:39:17,157 - INFO - Skip interface_detach for VM ctest-right_vm-63253500 in state BUILD
2025-07-21 13:39:17,157 - INFO - Deleting VM ctest-right_vm-63253500
2025-07-21 13:39:17,158 - ERROR - VM ctest-right_vm-63253500 has failed to come up
2025-07-21 13:39:17,158 - ERROR - Nova failed to get host of the VM
2025-07-21 13:39:17,349 - INFO - Skip interface_detach for VM ctest-left_vm-14171254 in state BUILD
2025-07-21 13:39:17,349 - INFO - Deleting VM ctest-left_vm-14171254
2025-07-21 13:39:17,349 - ERROR - VM ctest-left_vm-14171254 has failed to come up
2025-07-21 13:39:17,350 - ERROR - Nova failed to get host of the VM
2025-07-21 13:39:17,450 - INFO - Deleting VN ctest-right_vn-32068269 
2025-07-21 13:39:17,499 - DEBUG - VN db41f92a-5b17-4c0c-95a1-825b165576b2 still in use: Unable to complete operation on network db41f92a-5b17-4c0c-95a1-825b165576b2. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-9c51ce4c-8c01-42bf-ad66-ed6926d572fc']
2025-07-21 13:39:17,499 - WARNING - Deleting VN ctest-right_vn-32068269 failed..Will retry
2025-07-21 13:39:19,774 - DEBUG - Response for deleting network ()
2025-07-21 13:39:19,775 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/61557775-cf88-40cf-8941-f9d25e15e70c
2025-07-21 13:39:19,790 - DEBUG - Response Code: 404
2025-07-21 13:39:19,790 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:39:19,810 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:39:19,835 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:39:19,965 - INFO - Validated that VN ctest-right_vn-32068269 is not found in API Server
2025-07-21 13:39:19,993 - DEBUG - VN ctest-right_vn-32068269 is not present in Agent 10.0.0.254 
2025-07-21 13:39:19,993 - INFO - Validated that VN ctest-right_vn-32068269 is not in any agent
2025-07-21 13:39:20,039 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-32068269 info
2025-07-21 13:39:20,040 - INFO - Deleting VN ctest-left_vn-79330360 
2025-07-21 13:39:20,261 - DEBUG - Response for deleting network ()
2025-07-21 13:39:20,261 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/93d1642c-ee31-432e-8f59-3108f0da2212
2025-07-21 13:39:20,270 - DEBUG - Response Code: 404
2025-07-21 13:39:20,270 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:39:20,277 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:39:20,338 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:39:20,461 - INFO - Validated that VN ctest-left_vn-79330360 is not found in API Server
2025-07-21 13:39:20,478 - DEBUG - VN ctest-left_vn-79330360 is not present in Agent 10.0.0.254 
2025-07-21 13:39:20,478 - INFO - Validated that VN ctest-left_vn-79330360 is not in any agent
2025-07-21 13:39:20,511 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-79330360 info
2025-07-21 13:39:20,511 - INFO - Deleting VN ctest-mgmt_vn-92060587 
2025-07-21 13:39:20,737 - DEBUG - Response for deleting network ()
2025-07-21 13:39:20,737 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ab4ef658-b31b-4a88-a653-15684bd8c85e
2025-07-21 13:39:20,748 - DEBUG - Response Code: 404
2025-07-21 13:39:20,748 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:39:20,756 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:39:20,774 - DEBUG - Requesting: http://10.0.0.254:8082/project/9ec4c24f-6cef-4136-b80d-537c048d255d
2025-07-21 13:39:20,879 - INFO - Validated that VN ctest-mgmt_vn-92060587 is not found in API Server
2025-07-21 13:39:20,902 - DEBUG - VN ctest-mgmt_vn-92060587 is not present in Agent 10.0.0.254 
2025-07-21 13:39:20,902 - INFO - Validated that VN ctest-mgmt_vn-92060587 is not in any agent
2025-07-21 13:39:20,939 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-92060587 info
2025-07-21 13:39:21,237 - ERROR - <pre>Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_firewall/test_svc_fw_basic.py", line 26, in test_svc_in_network_datapath
    create_svms=True)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network-nat.qcow2'
</pre>

2025-07-21 13:39:21,255 - DEBUG - No XMPP flaps were noticed during the test
2025-07-21 13:39:21,255 - INFO - 
2025-07-21 13:39:21,255 - INFO - END TEST : test_svc_in_network_datapath : FAILED[0:01:55]
2025-07-21 13:39:21,256 - INFO - --------------------------------------------------------------------------------
2025-07-21 13:39:22,247 - INFO - Deleted project: ctest-TestSvcRegr-49246486, ID : 9ec4c24f-6cef-4136-b80d-537c048d255d