]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2)
2025-08-04 03:22:05,146 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-49331826']
2025-08-04 03:22:05,475 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-49331826'] created succesfully
2025-08-04 03:22:05,900 - DEBUG - Image by name tiny_nat_fw not found
2025-08-04 03:22:05,900 - DEBUG - Installing image tiny_nat_fw
2025-08-04 03:22:05,900 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-08-04 03:22:05,901 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz
2025-08-04 03:22:05,901 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz
2025-08-04 03:22:05,940 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz -O /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-04 03:22:05,999 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-04 03:22:06,000 - DEBUG - Unzip image
2025-08-04 03:22:06,000 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-04 03:22:06,029 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2025-08-04 03:22:06,029 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-49331826']
2025-08-04 03:22:06,144 - INFO - Service template: ['default-domain', 'ctest-service_template_1-49331826'] deleted successfully.
2025-08-04 03:22:06,145 - INFO - Skip interface_detach for VM ctest-right_vm-21002079 in state BUILD
2025-08-04 03:22:06,145 - INFO - Deleting VM ctest-right_vm-21002079
2025-08-04 03:22:06,188 - ERROR - VM ctest-right_vm-21002079 has failed to come up
2025-08-04 03:22:06,188 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:06,188 - ERROR - VM ctest-right_vm-21002079 has failed to come up
2025-08-04 03:22:06,188 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:06,291 - INFO - Skip interface_detach for VM ctest-left_vm-41353567 in state BUILD
2025-08-04 03:22:06,291 - INFO - Deleting VM ctest-left_vm-41353567
2025-08-04 03:22:06,291 - ERROR - VM ctest-left_vm-41353567 has failed to come up
2025-08-04 03:22:06,292 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:06,292 - ERROR - VM ctest-left_vm-41353567 has failed to come up
2025-08-04 03:22:06,292 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:06,385 - INFO - Deleting VN ctest-right_vn-58606472
2025-08-04 03:22:06,440 - DEBUG - VN 079a8ad3-7aa0-461a-ab62-c38b76b58cc2 still in use: Unable to complete operation on network 079a8ad3-7aa0-461a-ab62-c38b76b58cc2. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-3cb1104f-f85b-48bb-8219-58487c6c1d08']
2025-08-04 03:22:06,440 - WARNING - Deleting VN ctest-right_vn-58606472 failed..Will retry
2025-08-04 03:22:08,661 - DEBUG - Response for deleting network ()
2025-08-04 03:22:08,661 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/86748668-4c4f-4f3d-85c7-2dd1154b3c18
2025-08-04 03:22:08,668 - DEBUG - Response Code: 404
2025-08-04 03:22:08,668 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:08,676 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:08,706 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:08,831 - INFO - Validated that VN ctest-right_vn-58606472 is not found in API Server
2025-08-04 03:22:08,847 - DEBUG - VN ctest-right_vn-58606472 is not present in Agent 10.0.0.41
2025-08-04 03:22:08,868 - DEBUG - VN ctest-right_vn-58606472 is not present in Agent 10.0.0.57
2025-08-04 03:22:08,868 - INFO - Validated that VN ctest-right_vn-58606472 is not in any agent
2025-08-04 03:22:08,914 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-58606472 info
2025-08-04 03:22:08,914 - INFO - Deleting VN ctest-left_vn-70721694
2025-08-04 03:22:09,072 - DEBUG - Response for deleting network ()
2025-08-04 03:22:09,072 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/61d56907-af9c-473e-a66c-ce637d159b26
2025-08-04 03:22:09,081 - DEBUG - Response Code: 404
2025-08-04 03:22:09,081 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:09,106 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:09,133 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:09,255 - INFO - Validated that VN ctest-left_vn-70721694 is not found in API Server
2025-08-04 03:22:09,273 - DEBUG - VN ctest-left_vn-70721694 is not present in Agent 10.0.0.41
2025-08-04 03:22:09,300 - DEBUG - VN ctest-left_vn-70721694 is not present in Agent 10.0.0.57
2025-08-04 03:22:09,300 - INFO - Validated that VN ctest-left_vn-70721694 is not in any agent
2025-08-04 03:22:09,379 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-70721694 info
2025-08-04 03:22:09,379 - INFO - Deleting VN ctest-mgmt_vn-63709236
2025-08-04 03:22:09,535 - DEBUG - Response for deleting network ()
2025-08-04 03:22:09,535 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/72b1c6c8-7cb6-4ba6-9e59-0ebdbede483a
2025-08-04 03:22:09,544 - DEBUG - Response Code: 404
2025-08-04 03:22:09,544 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:09,552 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:09,590 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:09,686 - INFO - Validated that VN ctest-mgmt_vn-63709236 is not found in API Server
2025-08-04 03:22:09,702 - DEBUG - VN ctest-mgmt_vn-63709236 is not present in Agent 10.0.0.41
2025-08-04 03:22:09,724 - DEBUG - VN ctest-mgmt_vn-63709236 is not present in Agent 10.0.0.57
2025-08-04 03:22:09,724 - INFO - Validated that VN ctest-mgmt_vn-63709236 is not in any agent
2025-08-04 03:22:09,775 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-63709236 info
2025-08-04 03:22:09,777 - INFO - Deleting VM ctest-vm-in-third-vn-93509820
2025-08-04 03:22:09,849 - INFO - Deleting VN ctest-third-vn-66151671
2025-08-04 03:22:09,894 - DEBUG - VN 013be962-48d6-4597-992f-572435acfc9b still in use: Unable to complete operation on network 013be962-48d6-4597-992f-572435acfc9b. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-01c96d25-fbb6-4aaa-8a13-1f6352b69114']
2025-08-04 03:22:09,894 - WARNING - Deleting VN ctest-third-vn-66151671 failed..Will retry
2025-08-04 03:22:12,084 - DEBUG - Response for deleting network ()
2025-08-04 03:22:13,387 - DEBUG - No XMPP flaps were noticed during the test
2025-08-04 03:22:13,388 - INFO -
2025-08-04 03:22:13,388 - INFO - END TEST : test_svc_in_net_nat_with_static_routes : SKIPPED[0:00:26]
2025-08-04 03:22:13,388 - INFO - --------------------------------------------------------------------------------
2025-08-04 03:22:13,393 - INFO - ================================================================================
2025-08-04 03:22:13,393 - INFO - STARTING TEST : test_svc_v2_transparent_datapath
2025-08-04 03:22:14,678 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.57': {'10.20.0.193': '0', '10.20.0.18': '0'}} with
2025-08-04 03:22:14,678 - INFO - Initial checks done. Running the testcase now
2025-08-04 03:22:14,678 - INFO -
2025-08-04 03:22:14,984 - DEBUG - Response for create_network : {'network': {'id': 'c84e6dbc-dcda-46af-becd-6e38a6fadddb', 'name': 'ctest-mgmt_vn-75682185', 'tenant_id': '4a4e5202e7304ed18b326d444ae53ec1', 'project_id': '4a4e5202e7304ed18b326d444ae53ec1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-91302170', 'ctest-mgmt_vn-75682185'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:22:15,251 - DEBUG - Response for create_subnet : {'subnet': {'id': '96ec5fd3-30e4-4378-aa86-dcd0f8a77f68', 'name': '', 'tenant_id': '4a4e5202e7304ed18b326d444ae53ec1', 'network_id': 'c84e6dbc-dcda-46af-becd-6e38a6fadddb', 'ip_version': 4, 'cidr': '85.234.220.0/26', 'allocation_pools': [{'start': '85.234.220.2', 'end': '85.234.220.62'}], 'gateway_ip': '85.234.220.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '85.234.220.2', 'tags': [], 'project_id': '4a4e5202e7304ed18b326d444ae53ec1'}}
2025-08-04 03:22:15,284 - INFO - Created VN ctest-mgmt_vn-75682185
2025-08-04 03:22:15,300 - DEBUG - VN ctest-mgmt_vn-75682185 UUID is c84e6dbc-dcda-46af-becd-6e38a6fadddb
2025-08-04 03:22:15,403 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:15,414 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:15,433 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:15,535 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c84e6dbc-dcda-46af-becd-6e38a6fadddb
2025-08-04 03:22:15,553 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c84e6dbc-dcda-46af-becd-6e38a6fadddb
2025-08-04 03:22:15,566 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/809e6c31-2b07-4661-a778-cc7dacb134ff
2025-08-04 03:22:15,578 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/809e6c31-2b07-4661-a778-cc7dacb134ff
2025-08-04 03:22:15,587 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/c08cf316-3b74-4921-bc26-e8180d1f0efd
2025-08-04 03:22:15,596 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:22:15,596 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c84e6dbc-dcda-46af-becd-6e38a6fadddb
2025-08-04 03:22:15,608 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/809e6c31-2b07-4661-a778-cc7dacb134ff
2025-08-04 03:22:15,628 - INFO - Verified VN network id 13 for VN c84e6dbc-dcda-46af-becd-6e38a6fadddb
2025-08-04 03:22:15,630 - INFO - Verifications in API Server for VN ctest-mgmt_vn-75682185 passed
2025-08-04 03:22:15,630 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c84e6dbc-dcda-46af-becd-6e38a6fadddb
2025-08-04 03:22:15,643 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/809e6c31-2b07-4661-a778-cc7dacb134ff
2025-08-04 03:22:15,653 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/809e6c31-2b07-4661-a778-cc7dacb134ff
2025-08-04 03:22:15,662 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/c08cf316-3b74-4921-bc26-e8180d1f0efd
2025-08-04 03:22:15,676 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14433594513695590063', 'uuid-lslong': '13748766427030674907'}, 'enable': 'true', 'created': '2025-08-04T03:22:14', 'last-modified': '2025-08-04T03:22:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.485990'}
2025-08-04 03:22:15,688 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:22:15,696 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14433594513695590063', 'uuid-lslong': '13748766427030674907'}, 'enable': 'true', 'created': '2025-08-04T03:22:14', 'last-modified': '2025-08-04T03:22:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.511190'}
2025-08-04 03:22:15,706 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:22:15,713 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14433594513695590063', 'uuid-lslong': '13748766427030674907'}, 'enable': 'true', 'created': '2025-08-04T03:22:14', 'last-modified': '2025-08-04T03:22:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.527609'}
2025-08-04 03:22:15,722 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:22:15,722 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-75682185 passed
2025-08-04 03:22:15,723 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-75682185 in API_Server ======
2025-08-04 03:22:15,723 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:15,731 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:15,747 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:15,869 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c84e6dbc-dcda-46af-becd-6e38a6fadddb
2025-08-04 03:22:15,886 - DEBUG - =>VN ctest-mgmt_vn-75682185 has no policy to be verified
2025-08-04 03:22:15,886 - DEBUG - Verifying the vn in opserver
2025-08-04 03:22:15,886 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185 virtual network link through opserver 10.0.0.27
2025-08-04 03:22:15,886 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:22:15,902 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185?flat'}
2025-08-04 03:22:15,902 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185 virtual network link through opserver 10.0.0.38
2025-08-04 03:22:15,902 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:22:15,917 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185?flat'}
2025-08-04 03:22:15,918 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185 virtual network link through opserver 10.0.0.61
2025-08-04 03:22:15,918 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:22:15,933 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185?flat'}
2025-08-04 03:22:15,933 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-91302170:ctest-mgmt_vn-75682185 is found in opserver
2025-08-04 03:22:15,967 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:22:15,982 - DEBUG - VRF ids for VN ctest-mgmt_vn-75682185: {}
2025-08-04 03:22:16,281 - DEBUG - Response for create_network : {'network': {'id': '948ad134-6e93-4478-acb8-0e2c2fa74fba', 'name': 'ctest-left_vn-95724479', 'tenant_id': '4a4e5202e7304ed18b326d444ae53ec1', 'project_id': '4a4e5202e7304ed18b326d444ae53ec1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-91302170', 'ctest-left_vn-95724479'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:22:16,550 - DEBUG - Response for create_subnet : {'subnet': {'id': '0575c04e-53d2-4566-b7ef-a97429802670', 'name': '', 'tenant_id': '4a4e5202e7304ed18b326d444ae53ec1', 'network_id': '948ad134-6e93-4478-acb8-0e2c2fa74fba', 'ip_version': 4, 'cidr': '43.213.3.128/26', 'allocation_pools': [{'start': '43.213.3.130', 'end': '43.213.3.190'}], 'gateway_ip': '43.213.3.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '43.213.3.130', 'tags': [], 'project_id': '4a4e5202e7304ed18b326d444ae53ec1'}}
2025-08-04 03:22:16,582 - INFO - Created VN ctest-left_vn-95724479
2025-08-04 03:22:16,601 - DEBUG - VN ctest-left_vn-95724479 UUID is 948ad134-6e93-4478-acb8-0e2c2fa74fba
2025-08-04 03:22:16,698 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:16,709 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:16,731 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:16,848 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/948ad134-6e93-4478-acb8-0e2c2fa74fba
2025-08-04 03:22:16,866 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/948ad134-6e93-4478-acb8-0e2c2fa74fba
2025-08-04 03:22:16,882 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/846df532-0a14-4969-9f6e-077e99df4500
2025-08-04 03:22:16,893 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/846df532-0a14-4969-9f6e-077e99df4500
2025-08-04 03:22:16,905 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/dd5dba53-c156-46fd-b522-113c87057c97
2025-08-04 03:22:16,919 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:22:16,919 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/948ad134-6e93-4478-acb8-0e2c2fa74fba
2025-08-04 03:22:16,936 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/846df532-0a14-4969-9f6e-077e99df4500
2025-08-04 03:22:16,959 - INFO - Verified VN network id 14 for VN 948ad134-6e93-4478-acb8-0e2c2fa74fba
2025-08-04 03:22:16,960 - INFO - Verifications in API Server for VN ctest-left_vn-95724479 passed
2025-08-04 03:22:16,960 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/948ad134-6e93-4478-acb8-0e2c2fa74fba
2025-08-04 03:22:16,976 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/846df532-0a14-4969-9f6e-077e99df4500
2025-08-04 03:22:16,991 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/846df532-0a14-4969-9f6e-077e99df4500
2025-08-04 03:22:17,004 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/dd5dba53-c156-46fd-b522-113c87057c97
2025-08-04 03:22:17,026 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10703597487523054712', 'uuid-lslong': '12445713153179209658'}, 'enable': 'true', 'created': '2025-08-04T03:22:16', 'last-modified': '2025-08-04T03:22:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.549335'}
2025-08-04 03:22:17,036 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:22:17,049 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10703597487523054712', 'uuid-lslong': '12445713153179209658'}, 'enable': 'true', 'created': '2025-08-04T03:22:16', 'last-modified': '2025-08-04T03:22:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.569472'}
2025-08-04 03:22:17,062 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:22:17,071 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10703597487523054712', 'uuid-lslong': '12445713153179209658'}, 'enable': 'true', 'created': '2025-08-04T03:22:16', 'last-modified': '2025-08-04T03:22:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.597364'}
2025-08-04 03:22:17,081 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:22:17,081 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-95724479 passed
2025-08-04 03:22:17,081 - DEBUG - ====Verifying policy data for ctest-left_vn-95724479 in API_Server ======
2025-08-04 03:22:17,081 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:17,092 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:17,110 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:17,217 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/948ad134-6e93-4478-acb8-0e2c2fa74fba
2025-08-04 03:22:17,237 - DEBUG - =>VN ctest-left_vn-95724479 has no policy to be verified
2025-08-04 03:22:17,237 - DEBUG - Verifying the vn in opserver
2025-08-04 03:22:17,237 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479 virtual network link through opserver 10.0.0.27
2025-08-04 03:22:17,238 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:22:17,256 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479?flat'}
2025-08-04 03:22:17,256 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479 virtual network link through opserver 10.0.0.38
2025-08-04 03:22:17,257 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:22:17,276 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479?flat'}
2025-08-04 03:22:17,276 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479 virtual network link through opserver 10.0.0.61
2025-08-04 03:22:17,276 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:22:17,293 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479?flat'}
2025-08-04 03:22:17,293 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-91302170:ctest-left_vn-95724479 is found in opserver
2025-08-04 03:22:17,321 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:22:17,336 - DEBUG - VRF ids for VN ctest-left_vn-95724479: {}
2025-08-04 03:22:17,653 - DEBUG - Response for create_network : {'network': {'id': 'e5eccd0f-ae0d-4d28-ae2b-80c0b0ec0beb', 'name': 'ctest-right_vn-12441497', 'tenant_id': '4a4e5202e7304ed18b326d444ae53ec1', 'project_id': '4a4e5202e7304ed18b326d444ae53ec1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-91302170', 'ctest-right_vn-12441497'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:22:17,921 - DEBUG - Response for create_subnet : {'subnet': {'id': '4d97a594-fe6d-4c2f-a063-833dbe7afc51', 'name': '', 'tenant_id': '4a4e5202e7304ed18b326d444ae53ec1', 'network_id': 'e5eccd0f-ae0d-4d28-ae2b-80c0b0ec0beb', 'ip_version': 4, 'cidr': '7.155.177.128/26', 'allocation_pools': [{'start': '7.155.177.130', 'end': '7.155.177.190'}], 'gateway_ip': '7.155.177.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '7.155.177.130', 'tags': [], 'project_id': '4a4e5202e7304ed18b326d444ae53ec1'}}
2025-08-04 03:22:17,951 - INFO - Created VN ctest-right_vn-12441497
2025-08-04 03:22:17,967 - DEBUG - VN ctest-right_vn-12441497 UUID is e5eccd0f-ae0d-4d28-ae2b-80c0b0ec0beb
2025-08-04 03:22:18,054 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:18,062 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:18,078 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:18,183 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e5eccd0f-ae0d-4d28-ae2b-80c0b0ec0beb
2025-08-04 03:22:18,202 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e5eccd0f-ae0d-4d28-ae2b-80c0b0ec0beb
2025-08-04 03:22:18,215 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d4361f2d-9295-4d18-a3a9-d0906bb4fcf4
2025-08-04 03:22:18,226 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d4361f2d-9295-4d18-a3a9-d0906bb4fcf4
2025-08-04 03:22:18,234 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/46e080a8-4e58-4361-900b-6eed79a08859
2025-08-04 03:22:18,242 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:22:18,242 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e5eccd0f-ae0d-4d28-ae2b-80c0b0ec0beb
2025-08-04 03:22:18,254 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d4361f2d-9295-4d18-a3a9-d0906bb4fcf4
2025-08-04 03:22:18,278 - INFO - Verified VN network id 15 for VN e5eccd0f-ae0d-4d28-ae2b-80c0b0ec0beb
2025-08-04 03:22:18,279 - INFO - Verifications in API Server for VN ctest-right_vn-12441497 passed
2025-08-04 03:22:18,279 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e5eccd0f-ae0d-4d28-ae2b-80c0b0ec0beb
2025-08-04 03:22:18,293 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d4361f2d-9295-4d18-a3a9-d0906bb4fcf4
2025-08-04 03:22:18,305 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d4361f2d-9295-4d18-a3a9-d0906bb4fcf4
2025-08-04 03:22:18,315 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/46e080a8-4e58-4361-900b-6eed79a08859
2025-08-04 03:22:18,331 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16567842596417522984', 'uuid-lslong': '12550266351688354795'}, 'enable': 'true', 'created': '2025-08-04T03:22:17', 'last-modified': '2025-08-04T03:22:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.468010'}
2025-08-04 03:22:18,339 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:22:18,345 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16567842596417522984', 'uuid-lslong': '12550266351688354795'}, 'enable': 'true', 'created': '2025-08-04T03:22:17', 'last-modified': '2025-08-04T03:22:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.485091'}
2025-08-04 03:22:18,352 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:22:18,359 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16567842596417522984', 'uuid-lslong': '12550266351688354795'}, 'enable': 'true', 'created': '2025-08-04T03:22:17', 'last-modified': '2025-08-04T03:22:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.501649'}
2025-08-04 03:22:18,370 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:22:18,370 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-12441497 passed
2025-08-04 03:22:18,370 - DEBUG - ====Verifying policy data for ctest-right_vn-12441497 in API_Server ======
2025-08-04 03:22:18,371 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:18,381 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:18,398 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:18,502 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e5eccd0f-ae0d-4d28-ae2b-80c0b0ec0beb
2025-08-04 03:22:18,521 - DEBUG - =>VN ctest-right_vn-12441497 has no policy to be verified
2025-08-04 03:22:18,521 - DEBUG - Verifying the vn in opserver
2025-08-04 03:22:18,521 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497 virtual network link through opserver 10.0.0.27
2025-08-04 03:22:18,521 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:22:18,540 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497?flat'}
2025-08-04 03:22:18,540 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497 virtual network link through opserver 10.0.0.38
2025-08-04 03:22:18,540 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:22:18,557 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497?flat'}
2025-08-04 03:22:18,557 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497 virtual network link through opserver 10.0.0.61
2025-08-04 03:22:18,557 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:22:18,574 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497?flat'}
2025-08-04 03:22:18,574 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-91302170:ctest-right_vn-12441497 is found in opserver
2025-08-04 03:22:18,609 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:22:18,627 - DEBUG - VRF ids for VN ctest-right_vn-12441497: {}
2025-08-04 03:22:18,934 - DEBUG - Response for create_network : {'network': {'id': '3444d407-69e8-4f0a-ab7d-aa6b904ca66f', 'name': 'ctest-trans_left_vn-83948946', 'tenant_id': '4a4e5202e7304ed18b326d444ae53ec1', 'project_id': '4a4e5202e7304ed18b326d444ae53ec1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-91302170', 'ctest-trans_left_vn-83948946'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:22:19,222 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b6099961-98ac-493b-ba53-0feedbc6bf14', 'name': '', 'tenant_id': '4a4e5202e7304ed18b326d444ae53ec1', 'network_id': '3444d407-69e8-4f0a-ab7d-aa6b904ca66f', 'ip_version': 4, 'cidr': '110.183.183.0/26', 'allocation_pools': [{'start': '110.183.183.2', 'end': '110.183.183.62'}], 'gateway_ip': '110.183.183.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '110.183.183.2', 'tags': [], 'project_id': '4a4e5202e7304ed18b326d444ae53ec1'}}
2025-08-04 03:22:19,247 - INFO - Created VN ctest-trans_left_vn-83948946
2025-08-04 03:22:19,263 - DEBUG - VN ctest-trans_left_vn-83948946 UUID is 3444d407-69e8-4f0a-ab7d-aa6b904ca66f
2025-08-04 03:22:19,372 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:19,383 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:19,403 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:19,527 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3444d407-69e8-4f0a-ab7d-aa6b904ca66f
2025-08-04 03:22:19,545 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3444d407-69e8-4f0a-ab7d-aa6b904ca66f
2025-08-04 03:22:19,558 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/c4b0e894-4e7a-4786-8b7a-ba998d5029e9
2025-08-04 03:22:19,572 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/c4b0e894-4e7a-4786-8b7a-ba998d5029e9
2025-08-04 03:22:19,588 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/12802b7b-2c68-4430-87b3-ca7b552376cf
2025-08-04 03:22:19,602 - DEBUG - Route Targets: ['target:64512:8000008']
2025-08-04 03:22:19,602 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3444d407-69e8-4f0a-ab7d-aa6b904ca66f
2025-08-04 03:22:19,617 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/c4b0e894-4e7a-4786-8b7a-ba998d5029e9
2025-08-04 03:22:19,641 - INFO - Verified VN network id 16 for VN 3444d407-69e8-4f0a-ab7d-aa6b904ca66f
2025-08-04 03:22:19,642 - INFO - Verifications in API Server for VN ctest-trans_left_vn-83948946 passed
2025-08-04 03:22:19,642 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3444d407-69e8-4f0a-ab7d-aa6b904ca66f
2025-08-04 03:22:19,658 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/c4b0e894-4e7a-4786-8b7a-ba998d5029e9
2025-08-04 03:22:19,670 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/c4b0e894-4e7a-4786-8b7a-ba998d5029e9
2025-08-04 03:22:19,684 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/12802b7b-2c68-4430-87b3-ca7b552376cf
2025-08-04 03:22:19,708 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3766368316695269130', 'uuid-lslong': '12357220331533674095'}, 'enable': 'true', 'created': '2025-08-04T03:22:18', 'last-modified': '2025-08-04T03:22:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.557990'}
2025-08-04 03:22:19,718 - DEBUG - Route Targets: ['target:64512:8000008']
2025-08-04 03:22:19,726 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3766368316695269130', 'uuid-lslong': '12357220331533674095'}, 'enable': 'true', 'created': '2025-08-04T03:22:18', 'last-modified': '2025-08-04T03:22:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.584092'}
2025-08-04 03:22:19,733 - DEBUG - Route Targets: ['target:64512:8000008']
2025-08-04 03:22:19,741 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3766368316695269130', 'uuid-lslong': '12357220331533674095'}, 'enable': 'true', 'created': '2025-08-04T03:22:18', 'last-modified': '2025-08-04T03:22:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.590737'}
2025-08-04 03:22:19,750 - DEBUG - Route Targets: ['target:64512:8000008']
2025-08-04 03:22:19,750 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-83948946 passed
2025-08-04 03:22:19,750 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-83948946 in API_Server ======
2025-08-04 03:22:19,750 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:19,760 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:19,779 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:19,887 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3444d407-69e8-4f0a-ab7d-aa6b904ca66f
2025-08-04 03:22:19,903 - DEBUG - =>VN ctest-trans_left_vn-83948946 has no policy to be verified
2025-08-04 03:22:19,903 - DEBUG - Verifying the vn in opserver
2025-08-04 03:22:19,904 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946 virtual network link through opserver 10.0.0.27
2025-08-04 03:22:19,904 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:22:19,920 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946?flat'}
2025-08-04 03:22:19,920 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946 virtual network link through opserver 10.0.0.38
2025-08-04 03:22:19,920 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:22:19,937 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946?flat'}
2025-08-04 03:22:19,937 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946 virtual network link through opserver 10.0.0.61
2025-08-04 03:22:19,937 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:22:19,956 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946?flat'}
2025-08-04 03:22:19,956 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-91302170:ctest-trans_left_vn-83948946 is found in opserver
2025-08-04 03:22:19,995 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:22:20,013 - DEBUG - VRF ids for VN ctest-trans_left_vn-83948946: {}
2025-08-04 03:22:20,330 - DEBUG - Response for create_network : {'network': {'id': '55b09ce3-fba7-44b3-a797-c268bc973a98', 'name': 'ctest-trans_right_vn-86485602', 'tenant_id': '4a4e5202e7304ed18b326d444ae53ec1', 'project_id': '4a4e5202e7304ed18b326d444ae53ec1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-91302170', 'ctest-trans_right_vn-86485602'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:22:20,557 - DEBUG - Response for create_subnet : {'subnet': {'id': 'aa25e6d9-b3d7-48d4-bf97-1e3a379b2225', 'name': '', 'tenant_id': '4a4e5202e7304ed18b326d444ae53ec1', 'network_id': '55b09ce3-fba7-44b3-a797-c268bc973a98', 'ip_version': 4, 'cidr': '2.220.132.192/26', 'allocation_pools': [{'start': '2.220.132.194', 'end': '2.220.132.254'}], 'gateway_ip': '2.220.132.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2.220.132.194', 'tags': [], 'project_id': '4a4e5202e7304ed18b326d444ae53ec1'}}
2025-08-04 03:22:20,582 - INFO - Created VN ctest-trans_right_vn-86485602
2025-08-04 03:22:20,597 - DEBUG - VN ctest-trans_right_vn-86485602 UUID is 55b09ce3-fba7-44b3-a797-c268bc973a98
2025-08-04 03:22:20,678 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:20,686 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:20,703 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:20,798 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/55b09ce3-fba7-44b3-a797-c268bc973a98
2025-08-04 03:22:20,813 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/55b09ce3-fba7-44b3-a797-c268bc973a98
2025-08-04 03:22:20,824 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/afb2bf58-53d1-4392-9682-268de623349a
2025-08-04 03:22:20,832 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/afb2bf58-53d1-4392-9682-268de623349a
2025-08-04 03:22:20,841 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/7c4de903-4bb9-4580-98d6-1dd52b1e123b
2025-08-04 03:22:20,850 - DEBUG - Route Targets: ['target:64512:8000009']
2025-08-04 03:22:20,850 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/55b09ce3-fba7-44b3-a797-c268bc973a98
2025-08-04 03:22:20,861 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/afb2bf58-53d1-4392-9682-268de623349a
2025-08-04 03:22:20,880 - INFO - Verified VN network id 17 for VN 55b09ce3-fba7-44b3-a797-c268bc973a98
2025-08-04 03:22:20,881 - INFO - Verifications in API Server for VN ctest-trans_right_vn-86485602 passed
2025-08-04 03:22:20,881 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/55b09ce3-fba7-44b3-a797-c268bc973a98
2025-08-04 03:22:20,892 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/afb2bf58-53d1-4392-9682-268de623349a
2025-08-04 03:22:20,906 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/afb2bf58-53d1-4392-9682-268de623349a
2025-08-04 03:22:20,916 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/7c4de903-4bb9-4580-98d6-1dd52b1e123b
2025-08-04 03:22:20,930 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6174607592118502579', 'uuid-lslong': '12076334680913689240'}, 'enable': 'true', 'created': '2025-08-04T03:22:20', 'last-modified': '2025-08-04T03:22:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.433898'}
2025-08-04 03:22:20,938 - DEBUG - Route Targets: ['target:64512:8000009']
2025-08-04 03:22:20,944 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6174607592118502579', 'uuid-lslong': '12076334680913689240'}, 'enable': 'true', 'created': '2025-08-04T03:22:20', 'last-modified': '2025-08-04T03:22:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.451791'}
2025-08-04 03:22:20,951 - DEBUG - Route Targets: ['target:64512:8000009']
2025-08-04 03:22:20,958 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-91302170', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6174607592118502579', 'uuid-lslong': '12076334680913689240'}, 'enable': 'true', 'created': '2025-08-04T03:22:20', 'last-modified': '2025-08-04T03:22:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.465116'}
2025-08-04 03:22:20,965 - DEBUG - Route Targets: ['target:64512:8000009']
2025-08-04 03:22:20,965 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-86485602 passed
2025-08-04 03:22:20,966 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-86485602 in API_Server ======
2025-08-04 03:22:20,966 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:20,974 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:20,990 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:21,086 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/55b09ce3-fba7-44b3-a797-c268bc973a98
2025-08-04 03:22:21,098 - DEBUG - =>VN ctest-trans_right_vn-86485602 has no policy to be verified
2025-08-04 03:22:21,098 - DEBUG - Verifying the vn in opserver
2025-08-04 03:22:21,098 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602 virtual network link through opserver 10.0.0.27
2025-08-04 03:22:21,098 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:22:21,113 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602?flat'}
2025-08-04 03:22:21,113 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602 virtual network link through opserver 10.0.0.38
2025-08-04 03:22:21,113 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:22:21,133 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602?flat'}
2025-08-04 03:22:21,133 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602 virtual network link through opserver 10.0.0.61
2025-08-04 03:22:21,133 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:22:21,150 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602?flat'}
2025-08-04 03:22:21,150 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-91302170:ctest-trans_right_vn-86485602 is found in opserver
2025-08-04 03:22:21,178 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:22:21,191 - DEBUG - VRF ids for VN ctest-trans_right_vn-86485602: {}
2025-08-04 03:22:22,365 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2)
2025-08-04 03:22:23,825 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-1)
2025-08-04 03:22:23,826 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-16863680']
2025-08-04 03:22:24,142 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-16863680'] created succesfully
2025-08-04 03:22:24,563 - DEBUG - Image by name tiny_trans_fw not found
2025-08-04 03:22:24,563 - DEBUG - Installing image tiny_trans_fw
2025-08-04 03:22:24,563 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-08-04 03:22:24,564 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz
2025-08-04 03:22:24,565 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz
2025-08-04 03:22:24,585 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz -O /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-08-04 03:22:24,627 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-08-04 03:22:24,627 - DEBUG - Unzip image
2025-08-04 03:22:24,627 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-08-04 03:22:24,654 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found
2025-08-04 03:22:24,655 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-16863680']
2025-08-04 03:22:24,756 - INFO - Service template: ['default-domain', 'ctest-service_template_1-16863680'] deleted successfully.
2025-08-04 03:22:24,756 - INFO - Skip interface_detach for VM ctest-right_vm-39908684 in state BUILD
2025-08-04 03:22:24,756 - INFO - Deleting VM ctest-right_vm-39908684
2025-08-04 03:22:24,756 - ERROR - VM ctest-right_vm-39908684 has failed to come up
2025-08-04 03:22:24,756 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:24,756 - ERROR - VM ctest-right_vm-39908684 has failed to come up
2025-08-04 03:22:24,756 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:24,902 - INFO - Skip interface_detach for VM ctest-left_vm-70317058 in state BUILD
2025-08-04 03:22:24,902 - INFO - Deleting VM ctest-left_vm-70317058
2025-08-04 03:22:24,902 - ERROR - VM ctest-left_vm-70317058 has failed to come up
2025-08-04 03:22:24,902 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:24,902 - ERROR - VM ctest-left_vm-70317058 has failed to come up
2025-08-04 03:22:24,903 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:25,088 - INFO - Deleting VN ctest-trans_right_vn-86485602
2025-08-04 03:22:25,276 - DEBUG - Response for deleting network ()
2025-08-04 03:22:25,277 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/afb2bf58-53d1-4392-9682-268de623349a
2025-08-04 03:22:25,304 - DEBUG - Response Code: 404
2025-08-04 03:22:25,304 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:25,318 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:25,377 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:25,456 - INFO - Validated that VN ctest-trans_right_vn-86485602 is not found in API Server
2025-08-04 03:22:25,480 - DEBUG - VN ctest-trans_right_vn-86485602 is not present in Agent 10.0.0.41
2025-08-04 03:22:25,493 - DEBUG - VN ctest-trans_right_vn-86485602 is not present in Agent 10.0.0.57
2025-08-04 03:22:25,493 - INFO - Validated that VN ctest-trans_right_vn-86485602 is not in any agent
2025-08-04 03:22:25,543 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-86485602 info
2025-08-04 03:22:25,544 - INFO - Deleting VN ctest-trans_left_vn-83948946
2025-08-04 03:22:25,728 - DEBUG - Response for deleting network ()
2025-08-04 03:22:25,728 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/c4b0e894-4e7a-4786-8b7a-ba998d5029e9
2025-08-04 03:22:25,738 - DEBUG - Response Code: 404
2025-08-04 03:22:25,739 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:25,757 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:25,772 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:25,908 - INFO - Validated that VN ctest-trans_left_vn-83948946 is not found in API Server
2025-08-04 03:22:25,947 - DEBUG - VN ctest-trans_left_vn-83948946 is not present in Agent 10.0.0.41
2025-08-04 03:22:25,961 - DEBUG - VN ctest-trans_left_vn-83948946 is not present in Agent 10.0.0.57
2025-08-04 03:22:25,961 - INFO - Validated that VN ctest-trans_left_vn-83948946 is not in any agent
2025-08-04 03:22:26,029 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-83948946 info
2025-08-04 03:22:26,029 - INFO - Deleting VN ctest-right_vn-12441497
2025-08-04 03:22:26,090 - DEBUG - VN e5eccd0f-ae0d-4d28-ae2b-80c0b0ec0beb still in use: Unable to complete operation on network e5eccd0f-ae0d-4d28-ae2b-80c0b0ec0beb. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-b38685d9-c7fb-4949-82f4-9046070d4b11']
2025-08-04 03:22:26,090 - WARNING - Deleting VN ctest-right_vn-12441497 failed..Will retry
2025-08-04 03:22:28,258 - DEBUG - Response for deleting network ()
2025-08-04 03:22:28,259 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d4361f2d-9295-4d18-a3a9-d0906bb4fcf4
2025-08-04 03:22:28,273 - DEBUG - Response Code: 404
2025-08-04 03:22:28,273 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:28,289 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:28,317 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:28,438 - INFO - Validated that VN ctest-right_vn-12441497 is not found in API Server
2025-08-04 03:22:28,455 - DEBUG - VN ctest-right_vn-12441497 is not present in Agent 10.0.0.41
2025-08-04 03:22:28,469 - DEBUG - VN ctest-right_vn-12441497 is not present in Agent 10.0.0.57
2025-08-04 03:22:28,469 - INFO - Validated that VN ctest-right_vn-12441497 is not in any agent
2025-08-04 03:22:28,512 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-12441497 info
2025-08-04 03:22:28,512 - INFO - Deleting VN ctest-left_vn-95724479
2025-08-04 03:22:28,695 - DEBUG - Response for deleting network ()
2025-08-04 03:22:28,696 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/846df532-0a14-4969-9f6e-077e99df4500
2025-08-04 03:22:28,704 - DEBUG - Response Code: 404
2025-08-04 03:22:28,705 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:28,712 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:28,748 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:28,868 - INFO - Validated that VN ctest-left_vn-95724479 is not found in API Server
2025-08-04 03:22:28,884 - DEBUG - VN ctest-left_vn-95724479 is not present in Agent 10.0.0.41
2025-08-04 03:22:28,901 - DEBUG - VN ctest-left_vn-95724479 is not present in Agent 10.0.0.57
2025-08-04 03:22:28,901 - INFO - Validated that VN ctest-left_vn-95724479 is not in any agent
2025-08-04 03:22:28,946 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-95724479 info
2025-08-04 03:22:28,946 - INFO - Deleting VN ctest-mgmt_vn-75682185
2025-08-04 03:22:29,147 - DEBUG - Response for deleting network ()
2025-08-04 03:22:29,147 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/809e6c31-2b07-4661-a778-cc7dacb134ff
2025-08-04 03:22:29,154 - DEBUG - Response Code: 404
2025-08-04 03:22:29,154 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:29,161 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:29,183 - DEBUG - Requesting: http://10.0.0.27:8082/project/4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:29,304 - INFO - Validated that VN ctest-mgmt_vn-75682185 is not found in API Server
2025-08-04 03:22:29,320 - DEBUG - VN ctest-mgmt_vn-75682185 is not present in Agent 10.0.0.41
2025-08-04 03:22:29,332 - DEBUG - VN ctest-mgmt_vn-75682185 is not present in Agent 10.0.0.57
2025-08-04 03:22:29,332 - INFO - Validated that VN ctest-mgmt_vn-75682185 is not in any agent
2025-08-04 03:22:29,372 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-75682185 info
2025-08-04 03:22:30,695 - DEBUG - No XMPP flaps were noticed during the test
2025-08-04 03:22:30,695 - INFO -
2025-08-04 03:22:30,695 - INFO - END TEST : test_svc_v2_transparent_datapath : SKIPPED[0:00:17]
2025-08-04 03:22:30,696 - INFO - --------------------------------------------------------------------------------
2025-08-04 03:22:31,545 - INFO - Deleted project: ctest-TestSvcRegr-91302170, ID : 4a4e5202-e730-4ed1-8b32-6d444ae53ec1
2025-08-04 03:22:31,806 - INFO - Domain Default found not creating
2025-08-04 03:22:32,004 - INFO - Project ctest-TestSvcRegr-28767035 not found, creating it
2025-08-04 03:22:32,699 - INFO - Created Project:ctest-TestSvcRegr-28767035, ID : d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:34,279 - INFO - ================================================================================
2025-08-04 03:22:34,279 - INFO - STARTING TEST : test_svc_CEM_22032
2025-08-04 03:22:35,557 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.57': {'10.20.0.193': '0', '10.20.0.18': '0'}} with
2025-08-04 03:22:35,557 - INFO - Initial checks done. Running the testcase now
2025-08-04 03:22:35,557 - INFO -
2025-08-04 03:22:36,300 - DEBUG - Response for create_network : {'network': {'id': '4a0704fa-61a8-476f-bb7f-f389e4545559', 'name': 'ctest-mgmt_vn-01225968', 'tenant_id': 'd628feb6034b4199bb0196a191560b8d', 'project_id': 'd628feb6034b4199bb0196a191560b8d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-28767035', 'ctest-mgmt_vn-01225968'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:22:36,592 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ea959c05-75a2-49a4-b345-5bcc3f043dfb', 'name': '', 'tenant_id': 'd628feb6034b4199bb0196a191560b8d', 'network_id': '4a0704fa-61a8-476f-bb7f-f389e4545559', 'ip_version': 4, 'cidr': '12.169.216.0/26', 'allocation_pools': [{'start': '12.169.216.2', 'end': '12.169.216.62'}], 'gateway_ip': '12.169.216.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '12.169.216.2', 'tags': [], 'project_id': 'd628feb6034b4199bb0196a191560b8d'}}
2025-08-04 03:22:36,624 - INFO - Created VN ctest-mgmt_vn-01225968
2025-08-04 03:22:36,640 - DEBUG - VN ctest-mgmt_vn-01225968 UUID is 4a0704fa-61a8-476f-bb7f-f389e4545559
2025-08-04 03:22:36,739 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:37,062 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:37,094 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:37,116 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:37,227 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/4a0704fa-61a8-476f-bb7f-f389e4545559
2025-08-04 03:22:37,241 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/4a0704fa-61a8-476f-bb7f-f389e4545559
2025-08-04 03:22:37,253 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a62019c6-55fb-424d-a920-b77de1ea7efd
2025-08-04 03:22:37,265 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a62019c6-55fb-424d-a920-b77de1ea7efd
2025-08-04 03:22:37,273 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/7c4c4a8c-6ff6-4c44-9686-8d2045764117
2025-08-04 03:22:37,282 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:22:37,282 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/4a0704fa-61a8-476f-bb7f-f389e4545559
2025-08-04 03:22:37,296 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a62019c6-55fb-424d-a920-b77de1ea7efd
2025-08-04 03:22:37,319 - INFO - Verified VN network id 13 for VN 4a0704fa-61a8-476f-bb7f-f389e4545559
2025-08-04 03:22:37,320 - INFO - Verifications in API Server for VN ctest-mgmt_vn-01225968 passed
2025-08-04 03:22:37,320 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/4a0704fa-61a8-476f-bb7f-f389e4545559
2025-08-04 03:22:37,337 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a62019c6-55fb-424d-a920-b77de1ea7efd
2025-08-04 03:22:37,347 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a62019c6-55fb-424d-a920-b77de1ea7efd
2025-08-04 03:22:37,358 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/7c4c4a8c-6ff6-4c44-9686-8d2045764117
2025-08-04 03:22:37,377 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5334237757070395247', 'uuid-lslong': '13510785180701578585'}, 'enable': 'true', 'created': '2025-08-04T03:22:36', 'last-modified': '2025-08-04T03:22:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.838093'}
2025-08-04 03:22:37,386 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:22:37,399 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5334237757070395247', 'uuid-lslong': '13510785180701578585'}, 'enable': 'true', 'created': '2025-08-04T03:22:36', 'last-modified': '2025-08-04T03:22:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.858453'}
2025-08-04 03:22:37,408 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:22:37,416 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5334237757070395247', 'uuid-lslong': '13510785180701578585'}, 'enable': 'true', 'created': '2025-08-04T03:22:36', 'last-modified': '2025-08-04T03:22:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.880089'}
2025-08-04 03:22:37,430 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:22:37,430 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-01225968 passed
2025-08-04 03:22:37,431 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-01225968 in API_Server ======
2025-08-04 03:22:37,431 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:37,438 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:37,455 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:37,554 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/4a0704fa-61a8-476f-bb7f-f389e4545559
2025-08-04 03:22:37,566 - DEBUG - =>VN ctest-mgmt_vn-01225968 has no policy to be verified
2025-08-04 03:22:37,566 - DEBUG - Verifying the vn in opserver
2025-08-04 03:22:37,566 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968 virtual network link through opserver 10.0.0.27
2025-08-04 03:22:37,567 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:22:37,866 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:22:37,937 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968?flat'}
2025-08-04 03:22:37,937 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968 virtual network link through opserver 10.0.0.38
2025-08-04 03:22:37,937 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:22:38,242 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:22:38,317 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968?flat'}
2025-08-04 03:22:38,317 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968 virtual network link through opserver 10.0.0.61
2025-08-04 03:22:38,317 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:22:38,629 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:22:38,692 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968?flat'}
2025-08-04 03:22:38,692 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-01225968 is found in opserver
2025-08-04 03:22:38,720 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:22:38,733 - DEBUG - VRF ids for VN ctest-mgmt_vn-01225968: {}
2025-08-04 03:22:39,005 - DEBUG - Response for create_network : {'network': {'id': 'c948a32d-f946-47e4-9aaa-3d90c1499bcd', 'name': 'service-left-vn-66514702', 'tenant_id': 'd628feb6034b4199bb0196a191560b8d', 'project_id': 'd628feb6034b4199bb0196a191560b8d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-28767035', 'service-left-vn-66514702'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:22:39,242 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e642da7b-297d-428b-a290-cf583719b2c7', 'name': '', 'tenant_id': 'd628feb6034b4199bb0196a191560b8d', 'network_id': 'c948a32d-f946-47e4-9aaa-3d90c1499bcd', 'ip_version': 4, 'cidr': '63.204.254.64/26', 'allocation_pools': [{'start': '63.204.254.66', 'end': '63.204.254.126'}], 'gateway_ip': '63.204.254.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '63.204.254.66', 'tags': [], 'project_id': 'd628feb6034b4199bb0196a191560b8d'}}
2025-08-04 03:22:39,273 - INFO - Created VN service-left-vn-66514702
2025-08-04 03:22:39,286 - DEBUG - VN service-left-vn-66514702 UUID is c948a32d-f946-47e4-9aaa-3d90c1499bcd
2025-08-04 03:22:39,380 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:39,391 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:39,414 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:39,527 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c948a32d-f946-47e4-9aaa-3d90c1499bcd
2025-08-04 03:22:39,547 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c948a32d-f946-47e4-9aaa-3d90c1499bcd
2025-08-04 03:22:39,563 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9631b051-6caf-43a8-bd47-e4d29ec53c79
2025-08-04 03:22:39,575 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9631b051-6caf-43a8-bd47-e4d29ec53c79
2025-08-04 03:22:39,585 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/c0a05ce4-8b4b-49db-8b07-00050d609f4e
2025-08-04 03:22:39,594 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:22:39,594 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c948a32d-f946-47e4-9aaa-3d90c1499bcd
2025-08-04 03:22:39,608 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9631b051-6caf-43a8-bd47-e4d29ec53c79
2025-08-04 03:22:39,630 - INFO - Verified VN network id 14 for VN c948a32d-f946-47e4-9aaa-3d90c1499bcd
2025-08-04 03:22:39,630 - INFO - Verifications in API Server for VN service-left-vn-66514702 passed
2025-08-04 03:22:39,631 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c948a32d-f946-47e4-9aaa-3d90c1499bcd
2025-08-04 03:22:39,644 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9631b051-6caf-43a8-bd47-e4d29ec53c79
2025-08-04 03:22:39,654 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9631b051-6caf-43a8-bd47-e4d29ec53c79
2025-08-04 03:22:39,663 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/c0a05ce4-8b4b-49db-8b07-00050d609f4e
2025-08-04 03:22:39,681 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14504022017797670884', 'uuid-lslong': '11144787919809125325'}, 'enable': 'true', 'created': '2025-08-04T03:22:38', 'last-modified': '2025-08-04T03:22:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.491214'}
2025-08-04 03:22:39,690 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:22:39,699 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14504022017797670884', 'uuid-lslong': '11144787919809125325'}, 'enable': 'true', 'created': '2025-08-04T03:22:38', 'last-modified': '2025-08-04T03:22:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.506870'}
2025-08-04 03:22:39,709 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:22:39,720 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14504022017797670884', 'uuid-lslong': '11144787919809125325'}, 'enable': 'true', 'created': '2025-08-04T03:22:38', 'last-modified': '2025-08-04T03:22:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.527766'}
2025-08-04 03:22:39,728 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:22:39,728 - INFO - On all control nodes, Config, RI and RT verification for VN service-left-vn-66514702 passed
2025-08-04 03:22:39,728 - DEBUG - ====Verifying policy data for service-left-vn-66514702 in API_Server ======
2025-08-04 03:22:39,728 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:39,736 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:39,752 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:39,964 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c948a32d-f946-47e4-9aaa-3d90c1499bcd
2025-08-04 03:22:39,976 - DEBUG - =>VN service-left-vn-66514702 has no policy to be verified
2025-08-04 03:22:39,976 - DEBUG - Verifying the vn in opserver
2025-08-04 03:22:39,976 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702 virtual network link through opserver 10.0.0.27
2025-08-04 03:22:39,976 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:22:40,043 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702?flat'}
2025-08-04 03:22:40,043 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702 virtual network link through opserver 10.0.0.38
2025-08-04 03:22:40,043 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:22:40,109 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702?flat'}
2025-08-04 03:22:40,109 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702 virtual network link through opserver 10.0.0.61
2025-08-04 03:22:40,109 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:22:40,181 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702?flat'}
2025-08-04 03:22:40,181 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-28767035:service-left-vn-66514702 is found in opserver
2025-08-04 03:22:40,208 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:22:40,224 - DEBUG - VRF ids for VN service-left-vn-66514702: {}
2025-08-04 03:22:40,546 - DEBUG - Response for create_network : {'network': {'id': '23ccf991-0135-406d-a529-91df5fc055f8', 'name': 'service-right-vn-19258700', 'tenant_id': 'd628feb6034b4199bb0196a191560b8d', 'project_id': 'd628feb6034b4199bb0196a191560b8d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-28767035', 'service-right-vn-19258700'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:22:40,906 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fcf32acb-fc4d-4122-9ba6-97c82f6ab534', 'name': '', 'tenant_id': 'd628feb6034b4199bb0196a191560b8d', 'network_id': '23ccf991-0135-406d-a529-91df5fc055f8', 'ip_version': 4, 'cidr': '82.25.104.192/26', 'allocation_pools': [{'start': '82.25.104.194', 'end': '82.25.104.254'}], 'gateway_ip': '82.25.104.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '82.25.104.194', 'tags': [], 'project_id': 'd628feb6034b4199bb0196a191560b8d'}}
2025-08-04 03:22:40,930 - INFO - Created VN service-right-vn-19258700
2025-08-04 03:22:40,948 - DEBUG - VN service-right-vn-19258700 UUID is 23ccf991-0135-406d-a529-91df5fc055f8
2025-08-04 03:22:41,022 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:41,029 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:41,042 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:41,163 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/23ccf991-0135-406d-a529-91df5fc055f8
2025-08-04 03:22:41,178 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/23ccf991-0135-406d-a529-91df5fc055f8
2025-08-04 03:22:41,188 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/7eb77b47-03e2-4011-9fe7-de81284cc748
2025-08-04 03:22:41,196 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/7eb77b47-03e2-4011-9fe7-de81284cc748
2025-08-04 03:22:41,204 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/b597ae46-bc5d-457b-9ae7-f333fd840e4f
2025-08-04 03:22:41,212 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:22:41,212 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/23ccf991-0135-406d-a529-91df5fc055f8
2025-08-04 03:22:41,222 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/7eb77b47-03e2-4011-9fe7-de81284cc748
2025-08-04 03:22:41,241 - INFO - Verified VN network id 15 for VN 23ccf991-0135-406d-a529-91df5fc055f8
2025-08-04 03:22:41,241 - INFO - Verifications in API Server for VN service-right-vn-19258700 passed
2025-08-04 03:22:41,241 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/23ccf991-0135-406d-a529-91df5fc055f8
2025-08-04 03:22:41,252 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/7eb77b47-03e2-4011-9fe7-de81284cc748
2025-08-04 03:22:41,261 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/7eb77b47-03e2-4011-9fe7-de81284cc748
2025-08-04 03:22:41,268 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/b597ae46-bc5d-457b-9ae7-f333fd840e4f
2025-08-04 03:22:41,282 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2579711087762292845', 'uuid-lslong': '11901203878873421304'}, 'enable': 'true', 'created': '2025-08-04T03:22:40', 'last-modified': '2025-08-04T03:22:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.527051'}
2025-08-04 03:22:41,289 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:22:41,296 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2579711087762292845', 'uuid-lslong': '11901203878873421304'}, 'enable': 'true', 'created': '2025-08-04T03:22:40', 'last-modified': '2025-08-04T03:22:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.542079'}
2025-08-04 03:22:41,303 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:22:41,310 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2579711087762292845', 'uuid-lslong': '11901203878873421304'}, 'enable': 'true', 'created': '2025-08-04T03:22:40', 'last-modified': '2025-08-04T03:22:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.557348'}
2025-08-04 03:22:41,318 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:22:41,319 - INFO - On all control nodes, Config, RI and RT verification for VN service-right-vn-19258700 passed
2025-08-04 03:22:41,319 - DEBUG - ====Verifying policy data for service-right-vn-19258700 in API_Server ======
2025-08-04 03:22:41,319 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:41,326 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:41,341 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:41,443 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/23ccf991-0135-406d-a529-91df5fc055f8
2025-08-04 03:22:41,457 - DEBUG - =>VN service-right-vn-19258700 has no policy to be verified
2025-08-04 03:22:41,457 - DEBUG - Verifying the vn in opserver
2025-08-04 03:22:41,457 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700 virtual network link through opserver 10.0.0.27
2025-08-04 03:22:41,457 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:22:41,522 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700?flat'}
2025-08-04 03:22:41,522 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700 virtual network link through opserver 10.0.0.38
2025-08-04 03:22:41,522 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:22:41,586 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700?flat'}
2025-08-04 03:22:41,586 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700 virtual network link through opserver 10.0.0.61
2025-08-04 03:22:41,586 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:22:41,648 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700?flat'}
2025-08-04 03:22:41,648 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-28767035:service-right-vn-19258700 is found in opserver
2025-08-04 03:22:41,672 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:22:41,685 - DEBUG - VRF ids for VN service-right-vn-19258700: {}
2025-08-04 03:22:41,761 - DEBUG - Services list from nova: [, , , ]
2025-08-04 03:22:42,852 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2)
2025-08-04 03:22:44,291 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-1)
2025-08-04 03:22:44,291 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-48677599']
2025-08-04 03:22:44,605 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-48677599'] created succesfully
2025-08-04 03:22:45,009 - DEBUG - Image by name tiny_nat_fw not found
2025-08-04 03:22:45,009 - DEBUG - Installing image tiny_nat_fw
2025-08-04 03:22:45,009 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-08-04 03:22:45,010 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-04 03:22:45,010 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-04 03:22:45,010 - DEBUG - Unzip image
2025-08-04 03:22:45,010 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-04 03:22:45,056 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2025-08-04 03:22:45,056 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-48677599']
2025-08-04 03:22:45,212 - INFO - Service template: ['default-domain', 'ctest-service_template_1-48677599'] deleted successfully.
2025-08-04 03:22:45,212 - INFO - Skip interface_detach for VM ctest-right_vm-23698471 in state BUILD
2025-08-04 03:22:45,212 - INFO - Deleting VM ctest-right_vm-23698471
2025-08-04 03:22:45,261 - ERROR - VM ctest-right_vm-23698471 has failed to come up
2025-08-04 03:22:45,261 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:45,261 - ERROR - VM ctest-right_vm-23698471 has failed to come up
2025-08-04 03:22:45,261 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:45,341 - INFO - Skip interface_detach for VM ctest-left_vm-07023399 in state BUILD
2025-08-04 03:22:45,342 - INFO - Deleting VM ctest-left_vm-07023399
2025-08-04 03:22:45,342 - ERROR - VM ctest-left_vm-07023399 has failed to come up
2025-08-04 03:22:45,342 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:45,342 - ERROR - VM ctest-left_vm-07023399 has failed to come up
2025-08-04 03:22:45,342 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:45,485 - INFO - Deleting VN service-right-vn-19258700
2025-08-04 03:22:45,557 - DEBUG - VN 23ccf991-0135-406d-a529-91df5fc055f8 still in use: Unable to complete operation on network 23ccf991-0135-406d-a529-91df5fc055f8. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-671b80b7-3a9a-4a6c-9642-d28f3d761986']
2025-08-04 03:22:45,557 - WARNING - Deleting VN service-right-vn-19258700 failed..Will retry
2025-08-04 03:22:47,726 - DEBUG - Response for deleting network ()
2025-08-04 03:22:47,726 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/7eb77b47-03e2-4011-9fe7-de81284cc748
2025-08-04 03:22:47,733 - DEBUG - Response Code: 404
2025-08-04 03:22:47,734 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:47,741 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:47,765 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:47,879 - INFO - Validated that VN service-right-vn-19258700 is not found in API Server
2025-08-04 03:22:47,894 - DEBUG - VN service-right-vn-19258700 is not present in Agent 10.0.0.41
2025-08-04 03:22:47,906 - DEBUG - VN service-right-vn-19258700 is not present in Agent 10.0.0.57
2025-08-04 03:22:47,907 - INFO - Validated that VN service-right-vn-19258700 is not in any agent
2025-08-04 03:22:47,953 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-right-vn-19258700 info
2025-08-04 03:22:47,954 - INFO - Deleting VN service-left-vn-66514702
2025-08-04 03:22:48,143 - DEBUG - Response for deleting network ()
2025-08-04 03:22:48,144 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9631b051-6caf-43a8-bd47-e4d29ec53c79
2025-08-04 03:22:48,153 - DEBUG - Response Code: 404
2025-08-04 03:22:48,153 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:48,161 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:48,186 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:48,328 - INFO - Validated that VN service-left-vn-66514702 is not found in API Server
2025-08-04 03:22:48,347 - DEBUG - VN service-left-vn-66514702 is not present in Agent 10.0.0.41
2025-08-04 03:22:48,360 - DEBUG - VN service-left-vn-66514702 is not present in Agent 10.0.0.57
2025-08-04 03:22:48,361 - INFO - Validated that VN service-left-vn-66514702 is not in any agent
2025-08-04 03:22:48,403 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-left-vn-66514702 info
2025-08-04 03:22:48,404 - INFO - Deleting VN ctest-mgmt_vn-01225968
2025-08-04 03:22:48,558 - DEBUG - Response for deleting network ()
2025-08-04 03:22:48,558 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a62019c6-55fb-424d-a920-b77de1ea7efd
2025-08-04 03:22:48,565 - DEBUG - Response Code: 404
2025-08-04 03:22:48,565 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:48,574 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:48,589 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:48,698 - INFO - Validated that VN ctest-mgmt_vn-01225968 is not found in API Server
2025-08-04 03:22:48,714 - DEBUG - VN ctest-mgmt_vn-01225968 is not present in Agent 10.0.0.41
2025-08-04 03:22:48,731 - DEBUG - VN ctest-mgmt_vn-01225968 is not present in Agent 10.0.0.57
2025-08-04 03:22:48,731 - INFO - Validated that VN ctest-mgmt_vn-01225968 is not in any agent
2025-08-04 03:22:48,769 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-01225968 info
2025-08-04 03:22:50,048 - DEBUG - No XMPP flaps were noticed during the test
2025-08-04 03:22:50,048 - INFO -
2025-08-04 03:22:50,048 - INFO - END TEST : test_svc_CEM_22032 : SKIPPED[0:00:16]
2025-08-04 03:22:50,048 - INFO - --------------------------------------------------------------------------------
2025-08-04 03:22:50,051 - INFO - ================================================================================
2025-08-04 03:22:50,051 - INFO - STARTING TEST : test_svc_in_network_datapath
2025-08-04 03:22:51,336 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.57': {'10.20.0.193': '0', '10.20.0.18': '0'}} with
2025-08-04 03:22:51,336 - INFO - Initial checks done. Running the testcase now
2025-08-04 03:22:51,336 - INFO -
2025-08-04 03:22:51,629 - DEBUG - Response for create_network : {'network': {'id': 'b4f3857d-8048-429a-b134-0b71db9c2146', 'name': 'ctest-mgmt_vn-13648417', 'tenant_id': 'd628feb6034b4199bb0196a191560b8d', 'project_id': 'd628feb6034b4199bb0196a191560b8d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-28767035', 'ctest-mgmt_vn-13648417'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:22:51,888 - DEBUG - Response for create_subnet : {'subnet': {'id': '17029150-19d7-4dc6-b5be-83582695a34d', 'name': '', 'tenant_id': 'd628feb6034b4199bb0196a191560b8d', 'network_id': 'b4f3857d-8048-429a-b134-0b71db9c2146', 'ip_version': 4, 'cidr': '192.26.104.192/26', 'allocation_pools': [{'start': '192.26.104.194', 'end': '192.26.104.254'}], 'gateway_ip': '192.26.104.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '192.26.104.194', 'tags': [], 'project_id': 'd628feb6034b4199bb0196a191560b8d'}}
2025-08-04 03:22:51,915 - INFO - Created VN ctest-mgmt_vn-13648417
2025-08-04 03:22:51,930 - DEBUG - VN ctest-mgmt_vn-13648417 UUID is b4f3857d-8048-429a-b134-0b71db9c2146
2025-08-04 03:22:52,034 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:52,044 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:52,063 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:52,200 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b4f3857d-8048-429a-b134-0b71db9c2146
2025-08-04 03:22:52,218 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b4f3857d-8048-429a-b134-0b71db9c2146
2025-08-04 03:22:52,236 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a714cfb2-5d17-405c-a470-8aad32263882
2025-08-04 03:22:52,254 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a714cfb2-5d17-405c-a470-8aad32263882
2025-08-04 03:22:52,270 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/f26bfed0-9f41-46ec-b3de-68a3a5c78ec1
2025-08-04 03:22:52,284 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:22:52,285 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b4f3857d-8048-429a-b134-0b71db9c2146
2025-08-04 03:22:52,300 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a714cfb2-5d17-405c-a470-8aad32263882
2025-08-04 03:22:52,324 - INFO - Verified VN network id 13 for VN b4f3857d-8048-429a-b134-0b71db9c2146
2025-08-04 03:22:52,324 - INFO - Verifications in API Server for VN ctest-mgmt_vn-13648417 passed
2025-08-04 03:22:52,324 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b4f3857d-8048-429a-b134-0b71db9c2146
2025-08-04 03:22:52,339 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a714cfb2-5d17-405c-a470-8aad32263882
2025-08-04 03:22:52,353 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a714cfb2-5d17-405c-a470-8aad32263882
2025-08-04 03:22:52,367 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/f26bfed0-9f41-46ec-b3de-68a3a5c78ec1
2025-08-04 03:22:52,389 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13038912120237343386', 'uuid-lslong': '12768843427145851206'}, 'enable': 'true', 'created': '2025-08-04T03:22:51', 'last-modified': '2025-08-04T03:22:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.565646'}
2025-08-04 03:22:52,397 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:22:52,406 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13038912120237343386', 'uuid-lslong': '12768843427145851206'}, 'enable': 'true', 'created': '2025-08-04T03:22:51', 'last-modified': '2025-08-04T03:22:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.582544'}
2025-08-04 03:22:52,418 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:22:52,429 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13038912120237343386', 'uuid-lslong': '12768843427145851206'}, 'enable': 'true', 'created': '2025-08-04T03:22:51', 'last-modified': '2025-08-04T03:22:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.606220'}
2025-08-04 03:22:52,440 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:22:52,440 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-13648417 passed
2025-08-04 03:22:52,441 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-13648417 in API_Server ======
2025-08-04 03:22:52,441 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:52,450 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:52,468 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:52,570 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b4f3857d-8048-429a-b134-0b71db9c2146
2025-08-04 03:22:52,583 - DEBUG - =>VN ctest-mgmt_vn-13648417 has no policy to be verified
2025-08-04 03:22:52,583 - DEBUG - Verifying the vn in opserver
2025-08-04 03:22:52,583 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417 virtual network link through opserver 10.0.0.27
2025-08-04 03:22:52,583 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:22:52,598 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417?flat'}
2025-08-04 03:22:52,598 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417 virtual network link through opserver 10.0.0.38
2025-08-04 03:22:52,598 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:22:52,613 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417?flat'}
2025-08-04 03:22:52,613 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417 virtual network link through opserver 10.0.0.61
2025-08-04 03:22:52,613 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:22:52,629 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417?flat'}
2025-08-04 03:22:52,629 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-28767035:ctest-mgmt_vn-13648417 is found in opserver
2025-08-04 03:22:52,659 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:22:52,671 - DEBUG - VRF ids for VN ctest-mgmt_vn-13648417: {}
2025-08-04 03:22:52,959 - DEBUG - Response for create_network : {'network': {'id': '774d9e5f-566e-45a0-bc22-b024600e9e10', 'name': 'ctest-left_vn-28357790', 'tenant_id': 'd628feb6034b4199bb0196a191560b8d', 'project_id': 'd628feb6034b4199bb0196a191560b8d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-28767035', 'ctest-left_vn-28357790'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:22:53,226 - DEBUG - Response for create_subnet : {'subnet': {'id': '65c94c5e-5d85-4717-bc4b-aba558fe624e', 'name': '', 'tenant_id': 'd628feb6034b4199bb0196a191560b8d', 'network_id': '774d9e5f-566e-45a0-bc22-b024600e9e10', 'ip_version': 4, 'cidr': '212.10.243.64/26', 'allocation_pools': [{'start': '212.10.243.66', 'end': '212.10.243.126'}], 'gateway_ip': '212.10.243.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '212.10.243.66', 'tags': [], 'project_id': 'd628feb6034b4199bb0196a191560b8d'}}
2025-08-04 03:22:53,250 - INFO - Created VN ctest-left_vn-28357790
2025-08-04 03:22:53,267 - DEBUG - VN ctest-left_vn-28357790 UUID is 774d9e5f-566e-45a0-bc22-b024600e9e10
2025-08-04 03:22:53,349 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:53,356 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:53,371 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:53,472 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/774d9e5f-566e-45a0-bc22-b024600e9e10
2025-08-04 03:22:53,492 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/774d9e5f-566e-45a0-bc22-b024600e9e10
2025-08-04 03:22:53,506 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bf7ad8a8-4880-4a9a-a660-2b5554b8fbad
2025-08-04 03:22:53,519 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bf7ad8a8-4880-4a9a-a660-2b5554b8fbad
2025-08-04 03:22:53,529 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/7f64250d-d07f-4260-881e-e25f82aeb626
2025-08-04 03:22:53,537 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:22:53,537 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/774d9e5f-566e-45a0-bc22-b024600e9e10
2025-08-04 03:22:53,549 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bf7ad8a8-4880-4a9a-a660-2b5554b8fbad
2025-08-04 03:22:53,571 - INFO - Verified VN network id 14 for VN 774d9e5f-566e-45a0-bc22-b024600e9e10
2025-08-04 03:22:53,572 - INFO - Verifications in API Server for VN ctest-left_vn-28357790 passed
2025-08-04 03:22:53,572 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/774d9e5f-566e-45a0-bc22-b024600e9e10
2025-08-04 03:22:53,584 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bf7ad8a8-4880-4a9a-a660-2b5554b8fbad
2025-08-04 03:22:53,594 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bf7ad8a8-4880-4a9a-a660-2b5554b8fbad
2025-08-04 03:22:53,604 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/7f64250d-d07f-4260-881e-e25f82aeb626
2025-08-04 03:22:53,621 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8596701396029293984', 'uuid-lslong': '13556591498615496208'}, 'enable': 'true', 'created': '2025-08-04T03:22:52', 'last-modified': '2025-08-04T03:22:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.462996'}
2025-08-04 03:22:53,628 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:22:53,634 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8596701396029293984', 'uuid-lslong': '13556591498615496208'}, 'enable': 'true', 'created': '2025-08-04T03:22:52', 'last-modified': '2025-08-04T03:22:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.475418'}
2025-08-04 03:22:53,641 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:22:53,648 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8596701396029293984', 'uuid-lslong': '13556591498615496208'}, 'enable': 'true', 'created': '2025-08-04T03:22:52', 'last-modified': '2025-08-04T03:22:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.489526'}
2025-08-04 03:22:53,659 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:22:53,659 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-28357790 passed
2025-08-04 03:22:53,660 - DEBUG - ====Verifying policy data for ctest-left_vn-28357790 in API_Server ======
2025-08-04 03:22:53,660 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:53,667 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:53,682 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:53,777 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/774d9e5f-566e-45a0-bc22-b024600e9e10
2025-08-04 03:22:53,791 - DEBUG - =>VN ctest-left_vn-28357790 has no policy to be verified
2025-08-04 03:22:53,791 - DEBUG - Verifying the vn in opserver
2025-08-04 03:22:53,791 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790 virtual network link through opserver 10.0.0.27
2025-08-04 03:22:53,791 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:22:53,805 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790?flat'}
2025-08-04 03:22:53,805 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790 virtual network link through opserver 10.0.0.38
2025-08-04 03:22:53,805 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:22:53,819 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790?flat'}
2025-08-04 03:22:53,819 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790 virtual network link through opserver 10.0.0.61
2025-08-04 03:22:53,819 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:22:53,835 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790?flat'}
2025-08-04 03:22:53,835 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-28767035:ctest-left_vn-28357790 is found in opserver
2025-08-04 03:22:53,861 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:22:53,875 - DEBUG - VRF ids for VN ctest-left_vn-28357790: {}
2025-08-04 03:22:54,172 - DEBUG - Response for create_network : {'network': {'id': '9e4c5253-efda-4a85-b26c-2ff8bcaf3e95', 'name': 'ctest-right_vn-41277026', 'tenant_id': 'd628feb6034b4199bb0196a191560b8d', 'project_id': 'd628feb6034b4199bb0196a191560b8d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-28767035', 'ctest-right_vn-41277026'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:22:54,431 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ddffd545-9cfc-4bfa-a17a-2ba6ea740052', 'name': '', 'tenant_id': 'd628feb6034b4199bb0196a191560b8d', 'network_id': '9e4c5253-efda-4a85-b26c-2ff8bcaf3e95', 'ip_version': 4, 'cidr': '197.12.191.192/26', 'allocation_pools': [{'start': '197.12.191.194', 'end': '197.12.191.254'}], 'gateway_ip': '197.12.191.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '197.12.191.194', 'tags': [], 'project_id': 'd628feb6034b4199bb0196a191560b8d'}}
2025-08-04 03:22:54,454 - INFO - Created VN ctest-right_vn-41277026
2025-08-04 03:22:54,472 - DEBUG - VN ctest-right_vn-41277026 UUID is 9e4c5253-efda-4a85-b26c-2ff8bcaf3e95
2025-08-04 03:22:54,567 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:54,575 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:54,589 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:54,689 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e4c5253-efda-4a85-b26c-2ff8bcaf3e95
2025-08-04 03:22:54,702 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e4c5253-efda-4a85-b26c-2ff8bcaf3e95
2025-08-04 03:22:54,714 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/87a841aa-6116-4aa9-a67d-e1e5ce6ac315
2025-08-04 03:22:54,722 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/87a841aa-6116-4aa9-a67d-e1e5ce6ac315
2025-08-04 03:22:54,730 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/f43daa12-f3c0-47dd-b3e3-981b582ab813
2025-08-04 03:22:54,739 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:22:54,739 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e4c5253-efda-4a85-b26c-2ff8bcaf3e95
2025-08-04 03:22:54,751 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/87a841aa-6116-4aa9-a67d-e1e5ce6ac315
2025-08-04 03:22:54,769 - INFO - Verified VN network id 15 for VN 9e4c5253-efda-4a85-b26c-2ff8bcaf3e95
2025-08-04 03:22:54,770 - INFO - Verifications in API Server for VN ctest-right_vn-41277026 passed
2025-08-04 03:22:54,770 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e4c5253-efda-4a85-b26c-2ff8bcaf3e95
2025-08-04 03:22:54,781 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/87a841aa-6116-4aa9-a67d-e1e5ce6ac315
2025-08-04 03:22:54,792 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/87a841aa-6116-4aa9-a67d-e1e5ce6ac315
2025-08-04 03:22:54,805 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/f43daa12-f3c0-47dd-b3e3-981b582ab813
2025-08-04 03:22:54,820 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11406582476682447493', 'uuid-lslong': '12856703781599919765'}, 'enable': 'true', 'created': '2025-08-04T03:22:54', 'last-modified': '2025-08-04T03:22:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.448640'}
2025-08-04 03:22:54,829 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:22:54,835 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11406582476682447493', 'uuid-lslong': '12856703781599919765'}, 'enable': 'true', 'created': '2025-08-04T03:22:54', 'last-modified': '2025-08-04T03:22:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.463130'}
2025-08-04 03:22:54,842 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:22:54,850 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-28767035', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11406582476682447493', 'uuid-lslong': '12856703781599919765'}, 'enable': 'true', 'created': '2025-08-04T03:22:54', 'last-modified': '2025-08-04T03:22:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.469608'}
2025-08-04 03:22:54,858 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:22:54,858 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-41277026 passed
2025-08-04 03:22:54,858 - DEBUG - ====Verifying policy data for ctest-right_vn-41277026 in API_Server ======
2025-08-04 03:22:54,859 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:22:54,867 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:22:54,886 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:22:54,994 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e4c5253-efda-4a85-b26c-2ff8bcaf3e95
2025-08-04 03:22:55,008 - DEBUG - =>VN ctest-right_vn-41277026 has no policy to be verified
2025-08-04 03:22:55,008 - DEBUG - Verifying the vn in opserver
2025-08-04 03:22:55,008 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026 virtual network link through opserver 10.0.0.27
2025-08-04 03:22:55,008 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:22:55,023 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026?flat'}
2025-08-04 03:22:55,023 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026 virtual network link through opserver 10.0.0.38
2025-08-04 03:22:55,023 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:22:55,041 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026?flat'}
2025-08-04 03:22:55,041 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026 virtual network link through opserver 10.0.0.61
2025-08-04 03:22:55,042 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:22:55,061 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026?flat'}
2025-08-04 03:22:55,061 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-28767035:ctest-right_vn-41277026 is found in opserver
2025-08-04 03:22:55,095 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:22:55,114 - DEBUG - VRF ids for VN ctest-right_vn-41277026: {}
2025-08-04 03:22:56,581 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-1)
2025-08-04 03:22:57,974 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2)
2025-08-04 03:22:57,975 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-05728933']
2025-08-04 03:22:58,299 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-05728933'] created succesfully
2025-08-04 03:22:58,825 - DEBUG - Image by name tiny_nat_fw not found
2025-08-04 03:22:58,826 - DEBUG - Installing image tiny_nat_fw
2025-08-04 03:22:58,826 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-08-04 03:22:58,826 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-04 03:22:58,826 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-04 03:22:58,826 - DEBUG - Unzip image
2025-08-04 03:22:58,826 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-04 03:22:58,870 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2025-08-04 03:22:58,873 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-05728933']
2025-08-04 03:22:59,016 - INFO - Service template: ['default-domain', 'ctest-service_template_1-05728933'] deleted successfully.
2025-08-04 03:22:59,017 - INFO - Skip interface_detach for VM ctest-right_vm-65289858 in state BUILD
2025-08-04 03:22:59,017 - INFO - Deleting VM ctest-right_vm-65289858
2025-08-04 03:22:59,017 - ERROR - VM ctest-right_vm-65289858 has failed to come up
2025-08-04 03:22:59,017 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:59,017 - ERROR - VM ctest-right_vm-65289858 has failed to come up
2025-08-04 03:22:59,017 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:59,151 - INFO - Skip interface_detach for VM ctest-left_vm-75599111 in state BUILD
2025-08-04 03:22:59,152 - INFO - Deleting VM ctest-left_vm-75599111
2025-08-04 03:22:59,152 - ERROR - VM ctest-left_vm-75599111 has failed to come up
2025-08-04 03:22:59,152 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:59,152 - ERROR - VM ctest-left_vm-75599111 has failed to come up
2025-08-04 03:22:59,152 - ERROR - Nova failed to get host of the VM
2025-08-04 03:22:59,249 - INFO - Deleting VN ctest-right_vn-41277026
2025-08-04 03:22:59,304 - DEBUG - VN 9e4c5253-efda-4a85-b26c-2ff8bcaf3e95 still in use: Unable to complete operation on network 9e4c5253-efda-4a85-b26c-2ff8bcaf3e95. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-6a5be48e-743a-4a6e-8001-ce96fe8024a7']
2025-08-04 03:22:59,304 - WARNING - Deleting VN ctest-right_vn-41277026 failed..Will retry
2025-08-04 03:23:01,514 - DEBUG - Response for deleting network ()
2025-08-04 03:23:01,514 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/87a841aa-6116-4aa9-a67d-e1e5ce6ac315
2025-08-04 03:23:01,522 - DEBUG - Response Code: 404
2025-08-04 03:23:01,522 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:01,529 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:01,549 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:23:01,661 - INFO - Validated that VN ctest-right_vn-41277026 is not found in API Server
2025-08-04 03:23:01,673 - DEBUG - VN ctest-right_vn-41277026 is not present in Agent 10.0.0.41
2025-08-04 03:23:01,687 - DEBUG - VN ctest-right_vn-41277026 is not present in Agent 10.0.0.57
2025-08-04 03:23:01,687 - INFO - Validated that VN ctest-right_vn-41277026 is not in any agent
2025-08-04 03:23:01,727 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-41277026 info
2025-08-04 03:23:01,727 - INFO - Deleting VN ctest-left_vn-28357790
2025-08-04 03:23:01,886 - DEBUG - Response for deleting network ()
2025-08-04 03:23:01,886 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bf7ad8a8-4880-4a9a-a660-2b5554b8fbad
2025-08-04 03:23:01,893 - DEBUG - Response Code: 404
2025-08-04 03:23:01,894 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:01,918 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:01,948 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:23:02,055 - INFO - Validated that VN ctest-left_vn-28357790 is not found in API Server
2025-08-04 03:23:02,070 - DEBUG - VN ctest-left_vn-28357790 is not present in Agent 10.0.0.41
2025-08-04 03:23:02,085 - DEBUG - VN ctest-left_vn-28357790 is not present in Agent 10.0.0.57
2025-08-04 03:23:02,085 - INFO - Validated that VN ctest-left_vn-28357790 is not in any agent
2025-08-04 03:23:02,124 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-28357790 info
2025-08-04 03:23:02,125 - INFO - Deleting VN ctest-mgmt_vn-13648417
2025-08-04 03:23:02,280 - DEBUG - Response for deleting network ()
2025-08-04 03:23:02,280 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a714cfb2-5d17-405c-a470-8aad32263882
2025-08-04 03:23:02,288 - DEBUG - Response Code: 404
2025-08-04 03:23:02,288 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:02,302 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:02,370 - DEBUG - Requesting: http://10.0.0.27:8082/project/d628feb6-034b-4199-bb01-96a191560b8d
2025-08-04 03:23:02,463 - INFO - Validated that VN ctest-mgmt_vn-13648417 is not found in API Server
2025-08-04 03:23:02,477 - DEBUG - VN ctest-mgmt_vn-13648417 is not present in Agent 10.0.0.41
2025-08-04 03:23:02,490 - DEBUG - VN ctest-mgmt_vn-13648417 is not present in Agent 10.0.0.57
2025-08-04 03:23:02,490 - INFO - Validated that VN ctest-mgmt_vn-13648417 is not in any agent
2025-08-04 03:23:02,539 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-13648417 info
2025-08-04 03:23:03,811 - DEBUG - No XMPP flaps were noticed during the test
2025-08-04 03:23:03,811 - INFO -
2025-08-04 03:23:03,811 - INFO - END TEST : test_svc_in_network_datapath : SKIPPED[0:00:13]
2025-08-04 03:23:03,811 - INFO - --------------------------------------------------------------------------------
2025-08-04 03:23:04,605 - INFO - Deleted project: ctest-TestSvcRegr-28767035, ID : d628feb6-034b-4199-bb01-96a191560b8d