]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-1)
2026-01-22 03:03:01,632 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-55796755']
2026-01-22 03:03:01,942 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-55796755'] created succesfully
2026-01-22 03:03:02,369 - DEBUG - Image by name tiny_nat_fw not found
2026-01-22 03:03:02,369 - DEBUG - Installing image tiny_nat_fw
2026-01-22 03:03:02,369 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2026-01-22 03:03:02,370 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz
2026-01-22 03:03:02,370 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz
2026-01-22 03:03:02,390 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz -O /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2026-01-22 03:03:02,450 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2026-01-22 03:03:02,450 - DEBUG - Unzip image
2026-01-22 03:03:02,450 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2026-01-22 03:03:02,476 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2026-01-22 03:03:02,476 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-55796755']
2026-01-22 03:03:02,578 - INFO - Service template: ['default-domain', 'ctest-service_template_1-55796755'] deleted successfully.
2026-01-22 03:03:02,579 - INFO - Skip interface_detach for VM ctest-right_vm-70772649 in state BUILD
2026-01-22 03:03:02,579 - INFO - Deleting VM ctest-right_vm-70772649
2026-01-22 03:03:02,623 - ERROR - VM ctest-right_vm-70772649 has failed to come up
2026-01-22 03:03:02,624 - ERROR - Nova failed to get host of the VM
2026-01-22 03:03:02,624 - ERROR - VM ctest-right_vm-70772649 has failed to come up
2026-01-22 03:03:02,624 - ERROR - Nova failed to get host of the VM
2026-01-22 03:03:02,722 - INFO - Skip interface_detach for VM ctest-left_vm-72759520 in state BUILD
2026-01-22 03:03:02,722 - INFO - Deleting VM ctest-left_vm-72759520
2026-01-22 03:03:02,722 - ERROR - VM ctest-left_vm-72759520 has failed to come up
2026-01-22 03:03:02,722 - ERROR - Nova failed to get host of the VM
2026-01-22 03:03:02,723 - ERROR - VM ctest-left_vm-72759520 has failed to come up
2026-01-22 03:03:02,723 - ERROR - Nova failed to get host of the VM
2026-01-22 03:03:02,802 - INFO - Deleting VN ctest-right_vn-28730792
2026-01-22 03:03:02,869 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-1cc8baf2-e69e-410f-9362-4193505df245']
2026-01-22 03:03:02,869 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:04,912 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-2e42aff7-a95b-4a0d-8a26-09fbd32cedc4']
2026-01-22 03:03:04,913 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:06,954 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f9ee4b58-44db-464a-bf74-98c156a70eee']
2026-01-22 03:03:06,954 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:08,998 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-a64528c4-a16b-447e-8a2a-3619f69b943a']
2026-01-22 03:03:08,999 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:11,047 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-52f9355b-fe4d-4a24-9065-51a859fbeb6f']
2026-01-22 03:03:11,047 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:13,095 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-909886bb-3c54-481e-9892-839610313d0a']
2026-01-22 03:03:13,095 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:15,143 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-80eef7a1-42b0-472e-903b-16fdc99df4bb']
2026-01-22 03:03:15,144 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:17,186 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-66e7a47b-dced-4968-a1bd-528b6f427b66']
2026-01-22 03:03:17,186 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:19,230 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-3419c5cc-063a-496c-a9c4-433d8b76c2ca']
2026-01-22 03:03:19,230 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:21,277 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f4a9969c-9b1e-441f-a08a-e2cabf48e175']
2026-01-22 03:03:21,278 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:23,318 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-50cba14d-d083-465d-b3b2-56747847fc4f']
2026-01-22 03:03:23,318 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:25,362 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-21e3a966-d3ad-4521-b64b-4ed173f8d33f']
2026-01-22 03:03:25,362 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:27,402 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-3ce199b1-5703-44ce-a2ca-eb787849077b']
2026-01-22 03:03:27,402 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:29,443 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-ce62b5c6-a4cb-4ef0-a0a9-af19118ed0f4']
2026-01-22 03:03:29,443 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:31,489 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-ca524903-26d4-4b39-8311-35155dbe79ba']
2026-01-22 03:03:31,489 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:33,546 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-bc277bb4-d5d7-421f-ae3f-5a6288dd7f62']
2026-01-22 03:03:33,547 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:35,593 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f5767838-23c7-4969-a0e8-3eabdfbd84c7']
2026-01-22 03:03:35,593 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:37,638 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f80280f6-a6f5-45a3-9468-05990acdc361']
2026-01-22 03:03:37,639 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:39,692 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-091bfdca-77f6-4910-a103-52c4db9da96b']
2026-01-22 03:03:39,692 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:41,733 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-2552b8bb-5852-4f62-b8f9-fb379f868ae6']
2026-01-22 03:03:41,733 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:43,778 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-2506330c-401d-4650-95c8-27961a1a0d95']
2026-01-22 03:03:43,778 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:45,824 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-ec0dce7a-16c6-4319-813f-bce41ca92aa8']
2026-01-22 03:03:45,824 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:47,872 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-78d471b2-1f7a-4522-9de4-7414c39c8734']
2026-01-22 03:03:47,873 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:49,915 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-9dc13f42-18e2-42c1-91f7-f139ef5811c8']
2026-01-22 03:03:49,915 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:51,959 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f126f6e2-272d-40f0-9406-08d699773997']
2026-01-22 03:03:51,959 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:54,010 - DEBUG - VN f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787 still in use: Unable to complete operation on network f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-052cc71b-2a16-4f92-9b8d-a6a148fba3f5']
2026-01-22 03:03:54,010 - WARNING - Deleting VN ctest-right_vn-28730792 failed..Will retry
2026-01-22 03:03:54,010 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/19f339d0-68e3-4195-bc49-6f2bb4e29829
2026-01-22 03:03:54,020 - WARNING - RI ctest-right_vn-28730792 is still found in API-Server
2026-01-22 03:03:59,021 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/19f339d0-68e3-4195-bc49-6f2bb4e29829
2026-01-22 03:03:59,031 - WARNING - RI ctest-right_vn-28730792 is still found in API-Server
2026-01-22 03:04:04,032 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/19f339d0-68e3-4195-bc49-6f2bb4e29829
2026-01-22 03:04:04,042 - WARNING - RI ctest-right_vn-28730792 is still found in API-Server
2026-01-22 03:04:09,043 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/19f339d0-68e3-4195-bc49-6f2bb4e29829
2026-01-22 03:04:09,052 - WARNING - RI ctest-right_vn-28730792 is still found in API-Server
2026-01-22 03:04:14,053 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/19f339d0-68e3-4195-bc49-6f2bb4e29829
2026-01-22 03:04:14,062 - WARNING - RI ctest-right_vn-28730792 is still found in API-Server
2026-01-22 03:04:19,064 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/19f339d0-68e3-4195-bc49-6f2bb4e29829
2026-01-22 03:04:19,073 - WARNING - RI ctest-right_vn-28730792 is still found in API-Server
2026-01-22 03:04:24,074 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/19f339d0-68e3-4195-bc49-6f2bb4e29829
2026-01-22 03:04:24,082 - WARNING - RI ctest-right_vn-28730792 is still found in API-Server
2026-01-22 03:04:29,082 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/19f339d0-68e3-4195-bc49-6f2bb4e29829
2026-01-22 03:04:29,094 - WARNING - RI ctest-right_vn-28730792 is still found in API-Server
2026-01-22 03:04:34,095 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/19f339d0-68e3-4195-bc49-6f2bb4e29829
2026-01-22 03:04:34,103 - WARNING - RI ctest-right_vn-28730792 is still found in API-Server
2026-01-22 03:04:39,103 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/19f339d0-68e3-4195-bc49-6f2bb4e29829
2026-01-22 03:04:39,113 - WARNING - RI ctest-right_vn-28730792 is still found in API-Server
2026-01-22 03:04:44,113 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/19f339d0-68e3-4195-bc49-6f2bb4e29829
2026-01-22 03:04:44,122 - WARNING - RI ctest-right_vn-28730792 is still found in API-Server
2026-01-22 03:04:44,123 - INFO - Deleting VN ctest-left_vn-56622072
2026-01-22 03:04:44,301 - DEBUG - Response for deleting network ()
2026-01-22 03:04:44,301 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/87e1f1fc-69f4-400f-9445-5b746ffabffd
2026-01-22 03:04:44,307 - DEBUG - Response Code: 404
2026-01-22 03:04:44,307 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:04:44,317 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:04:44,378 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:04:44,474 - INFO - Validated that VN ctest-left_vn-56622072 is not found in API Server
2026-01-22 03:04:44,492 - DEBUG - VN ctest-left_vn-56622072 is not present in Agent 10.0.0.23
2026-01-22 03:04:44,503 - DEBUG - VN ctest-left_vn-56622072 is not present in Agent 10.0.0.141
2026-01-22 03:04:44,504 - INFO - Validated that VN ctest-left_vn-56622072 is not in any agent
2026-01-22 03:04:44,540 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-56622072 info
2026-01-22 03:04:44,541 - INFO - Deleting VN ctest-mgmt_vn-95910342
2026-01-22 03:04:44,748 - DEBUG - Response for deleting network ()
2026-01-22 03:04:44,748 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/32d5a99f-0f6c-4934-9641-976c33d392c8
2026-01-22 03:04:44,761 - DEBUG - Response Code: 404
2026-01-22 03:04:44,761 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:04:44,767 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:04:44,779 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:04:44,879 - INFO - Validated that VN ctest-mgmt_vn-95910342 is not found in API Server
2026-01-22 03:04:44,893 - DEBUG - VN ctest-mgmt_vn-95910342 is not present in Agent 10.0.0.23
2026-01-22 03:04:44,904 - DEBUG - VN ctest-mgmt_vn-95910342 is not present in Agent 10.0.0.141
2026-01-22 03:04:44,904 - INFO - Validated that VN ctest-mgmt_vn-95910342 is not in any agent
2026-01-22 03:04:44,938 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-95910342 info
2026-01-22 03:04:44,938 - INFO - Deleting VM ctest-vm-in-third-vn-49440553
2026-01-22 03:04:45,014 - INFO - Deleting VN ctest-third-vn-32919113
2026-01-22 03:04:45,068 - DEBUG - VN c83913e0-d058-4ba4-b4d9-1b393342e4f9 still in use: Unable to complete operation on network c83913e0-d058-4ba4-b4d9-1b393342e4f9. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-7b40e107-7909-4887-b185-486a52407dc2']
2026-01-22 03:04:45,068 - WARNING - Deleting VN ctest-third-vn-32919113 failed..Will retry
2026-01-22 03:04:47,254 - DEBUG - Response for deleting network ()
2026-01-22 03:04:48,016 - ERROR - [Errno 104] Connection reset by peer
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/svc_firewall/test_svc_fw.py", line 47, in test_svc_in_net_nat_with_static_routes
sc_info = self.verify_svc_chain(service_mode='in-network-nat',
File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
File "/contrail-test/common/servicechain/config.py", line 528, in config_svc_chain
svm_fixtures = self.create_service_vms(vns,
File "/contrail-test/common/servicechain/config.py", line 330, in create_service_vms
svm_fixture = self.config_vm_only(
File "/contrail-test/common/servicechain/config.py", line 159, in config_vm_only
vm_fixture = self.config_vm(
File "/contrail-test/common/servicechain/config.py", line 200, in config_vm
vm_fixture = self.useFixture(VMFixture(
File "/usr/local/lib/python3.9/site-packages/testtools/testcase.py", line 756, in useFixture
reraise(*exc_info)
File "/usr/local/lib/python3.9/site-packages/testtools/_compat3x.py", line 16, in reraise
raise exc_obj.with_traceback(exc_tb)
File "/usr/local/lib/python3.9/site-packages/testtools/testcase.py", line 731, in useFixture
fixture.setUp()
File "/contrail-test/fixtures/vm_test.py", line 193, in setUp
self.create()
File "/contrail-test/fixtures/vm_test.py", line 233, in create
objs = self.orch.create_vm(
File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
File "/contrail-test/fixtures/nova_test.py", line 582, in create_vm
image = self.get_image(image_name=image_name)
File "/contrail-test/fixtures/nova_test.py", line 199, in get_image
self._install_image(image_name=image_name)
File "/contrail-test/fixtures/nova_test.py", line 339, in _install_image
return self.copy_and_glance(build_path, image_name, params)
File "/contrail-test/fixtures/nova_test.py", line 409, in copy_and_glance
raise TestSkipped(f"image {image_path_real} is not found")
unittest2.case.SkipTest: image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/contrail-test/tcutils/cores.py", line 42, in get_cores_node
if exists(CORE_DIR):
File "/usr/local/lib/python3.9/site-packages/fabric/contrib/files.py", line 31, in exists
cmd = 'stat %s' % _expand_path(path)
File "/usr/local/lib/python3.9/site-packages/fabric/contrib/files.py", line 485, in _expand_path
return path if is_win() else '"$(echo %s)"' % path
File "/usr/local/lib/python3.9/site-packages/fabric/contrib/files.py", line 472, in is_win
return '"' in run('echo "Will you echo quotation marks"')
File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper
return func(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1092, in run
return _run_command(
File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command
channel=default_channel(), command=wrapped_command, pty=pty,
File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel
chan = _open_session()
File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 420, in _open_session
session = transport.open_session(timeout=env.timeout)
File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 919, in open_session
return self.open_channel(
File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1050, in open_channel
raise e
File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 2109, in run
ptype, m = self.packetizer.read_message()
File "/usr/local/lib/python3.9/site-packages/paramiko/packet.py", line 459, in read_message
header = self.read_all(self.__block_size_in, check_rekey=True)
File "/usr/local/lib/python3.9/site-packages/paramiko/packet.py", line 301, in read_all
x = self.__socket.recv(n)
File "/usr/local/lib64/python3.9/site-packages/gevent/_socketcommon.py", line 660, in recv
return self._sock.recv(*args)
ConnectionResetError: [Errno 104] Connection reset by peer
2026-01-22 03:04:48,304 - ERROR - XMPP status is {'10.0.0.23': {'10.20.0.19': '0', '10.20.0.5': '0'}, '10.0.0.141': {'10.20.0.19': '0', '10.20.0.5': '1'}}, Expected: {'10.0.0.23': {'10.20.0.19': '1', '10.20.0.5': '0'}, '10.0.0.141': {'10.20.0.19': '0', '10.20.0.5': '1'}}
2026-01-22 03:04:48,305 - INFO -
2026-01-22 03:04:48,305 - INFO - END TEST : test_svc_in_net_nat_with_static_routes : FAILED[0:02:04]
2026-01-22 03:04:48,305 - INFO - --------------------------------------------------------------------------------
2026-01-22 03:04:48,323 - INFO - ================================================================================
2026-01-22 03:04:48,323 - INFO - STARTING TEST : test_svc_v2_transparent_datapath
2026-01-22 03:04:50,869 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.19': '0', '10.20.0.5': '0'}, '10.0.0.141': {'10.20.0.19': '0', '10.20.0.5': '1'}} with
2026-01-22 03:04:50,869 - INFO - Initial checks done. Running the testcase now
2026-01-22 03:04:50,870 - INFO -
2026-01-22 03:04:51,127 - DEBUG - Response for create_network : {'network': {'id': '4b91ae79-1a88-4bd5-b56d-14e6173b373b', 'name': 'ctest-mgmt_vn-39507685', 'tenant_id': '77691a6484024416a296662aaca130b2', 'project_id': '77691a6484024416a296662aaca130b2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-mgmt_vn-39507685'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:04:51,336 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cbaac269-bd11-4414-8665-9ae116fc271c', 'name': '', 'tenant_id': '77691a6484024416a296662aaca130b2', 'network_id': '4b91ae79-1a88-4bd5-b56d-14e6173b373b', 'ip_version': 4, 'cidr': '79.101.17.64/26', 'allocation_pools': [{'start': '79.101.17.66', 'end': '79.101.17.126'}], 'gateway_ip': '79.101.17.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '79.101.17.66', 'tags': [], 'project_id': '77691a6484024416a296662aaca130b2'}}
2026-01-22 03:04:51,361 - INFO - Created VN ctest-mgmt_vn-39507685
2026-01-22 03:04:51,375 - DEBUG - VN ctest-mgmt_vn-39507685 UUID is 4b91ae79-1a88-4bd5-b56d-14e6173b373b
2026-01-22 03:04:51,447 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:04:51,455 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:04:51,465 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:04:51,558 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4b91ae79-1a88-4bd5-b56d-14e6173b373b
2026-01-22 03:04:51,571 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4b91ae79-1a88-4bd5-b56d-14e6173b373b
2026-01-22 03:04:51,581 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1fb8e714-6505-44a0-948c-e598d4a474c7
2026-01-22 03:04:51,589 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1fb8e714-6505-44a0-948c-e598d4a474c7
2026-01-22 03:04:51,595 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1cfff0c0-1527-4a69-9d14-b5227dced6ae
2026-01-22 03:04:51,603 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:04:51,603 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4b91ae79-1a88-4bd5-b56d-14e6173b373b
2026-01-22 03:04:51,611 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1fb8e714-6505-44a0-948c-e598d4a474c7
2026-01-22 03:04:51,625 - INFO - Verified VN network id 12 for VN 4b91ae79-1a88-4bd5-b56d-14e6173b373b
2026-01-22 03:04:51,625 - INFO - Verifications in API Server for VN ctest-mgmt_vn-39507685 passed
2026-01-22 03:04:51,625 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4b91ae79-1a88-4bd5-b56d-14e6173b373b
2026-01-22 03:04:51,634 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1fb8e714-6505-44a0-948c-e598d4a474c7
2026-01-22 03:04:51,640 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1fb8e714-6505-44a0-948c-e598d4a474c7
2026-01-22 03:04:51,646 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1cfff0c0-1527-4a69-9d14-b5227dced6ae
2026-01-22 03:04:51,659 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5445325259627056085', 'uuid-lslong': '13073128271791208251'}, 'enable': 'true', 'created': '2026-01-22T03:04:51', 'last-modified': '2026-01-22T03:04:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.380728'}
2026-01-22 03:04:51,664 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:04:51,670 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5445325259627056085', 'uuid-lslong': '13073128271791208251'}, 'enable': 'true', 'created': '2026-01-22T03:04:51', 'last-modified': '2026-01-22T03:04:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.390780'}
2026-01-22 03:04:51,676 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:04:51,682 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5445325259627056085', 'uuid-lslong': '13073128271791208251'}, 'enable': 'true', 'created': '2026-01-22T03:04:51', 'last-modified': '2026-01-22T03:04:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.404351'}
2026-01-22 03:04:51,687 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:04:51,687 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-39507685 passed
2026-01-22 03:04:51,688 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-39507685 in API_Server ======
2026-01-22 03:04:51,688 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:04:51,694 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:04:51,706 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:04:51,804 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4b91ae79-1a88-4bd5-b56d-14e6173b373b
2026-01-22 03:04:51,822 - DEBUG - =>VN ctest-mgmt_vn-39507685 has no policy to be verified
2026-01-22 03:04:51,822 - DEBUG - Verifying the vn in opserver
2026-01-22 03:04:51,822 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685 virtual network link through opserver 10.0.0.38
2026-01-22 03:04:51,822 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:04:51,836 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685?flat'}
2026-01-22 03:04:51,836 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685 virtual network link through opserver 10.0.0.50
2026-01-22 03:04:51,836 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:04:51,851 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685?flat'}
2026-01-22 03:04:51,851 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685 virtual network link through opserver 10.0.0.131
2026-01-22 03:04:51,852 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:04:51,865 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685?flat'}
2026-01-22 03:04:51,866 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-61409174:ctest-mgmt_vn-39507685 is found in opserver
2026-01-22 03:04:51,887 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 03:04:51,898 - DEBUG - VRF ids for VN ctest-mgmt_vn-39507685: {}
2026-01-22 03:04:52,144 - DEBUG - Response for create_network : {'network': {'id': '1598c944-6b08-40aa-bb86-55210eb71611', 'name': 'ctest-left_vn-46807250', 'tenant_id': '77691a6484024416a296662aaca130b2', 'project_id': '77691a6484024416a296662aaca130b2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-left_vn-46807250'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:04:52,443 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cac659fa-55d6-441d-803a-9db6ef1a54fb', 'name': '', 'tenant_id': '77691a6484024416a296662aaca130b2', 'network_id': '1598c944-6b08-40aa-bb86-55210eb71611', 'ip_version': 4, 'cidr': '15.4.239.64/26', 'allocation_pools': [{'start': '15.4.239.66', 'end': '15.4.239.126'}], 'gateway_ip': '15.4.239.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '15.4.239.66', 'tags': [], 'project_id': '77691a6484024416a296662aaca130b2'}}
2026-01-22 03:04:52,464 - INFO - Created VN ctest-left_vn-46807250
2026-01-22 03:04:52,476 - DEBUG - VN ctest-left_vn-46807250 UUID is 1598c944-6b08-40aa-bb86-55210eb71611
2026-01-22 03:04:52,549 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:04:52,555 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:04:52,566 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:04:52,650 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1598c944-6b08-40aa-bb86-55210eb71611
2026-01-22 03:04:52,663 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1598c944-6b08-40aa-bb86-55210eb71611
2026-01-22 03:04:52,672 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/24f8598a-b715-4daf-a601-d0cbf237fed7
2026-01-22 03:04:52,681 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/24f8598a-b715-4daf-a601-d0cbf237fed7
2026-01-22 03:04:52,690 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/d8b524ba-0857-4298-9334-c5e79a76b3cb
2026-01-22 03:04:52,697 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 03:04:52,697 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1598c944-6b08-40aa-bb86-55210eb71611
2026-01-22 03:04:52,707 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/24f8598a-b715-4daf-a601-d0cbf237fed7
2026-01-22 03:04:52,724 - INFO - Verified VN network id 13 for VN 1598c944-6b08-40aa-bb86-55210eb71611
2026-01-22 03:04:52,724 - INFO - Verifications in API Server for VN ctest-left_vn-46807250 passed
2026-01-22 03:04:52,724 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1598c944-6b08-40aa-bb86-55210eb71611
2026-01-22 03:04:52,736 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/24f8598a-b715-4daf-a601-d0cbf237fed7
2026-01-22 03:04:52,743 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/24f8598a-b715-4daf-a601-d0cbf237fed7
2026-01-22 03:04:52,752 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/d8b524ba-0857-4298-9334-c5e79a76b3cb
2026-01-22 03:04:52,767 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1556214966947168426', 'uuid-lslong': '13512581332440913425'}, 'enable': 'true', 'created': '2026-01-22T03:04:52', 'last-modified': '2026-01-22T03:04:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.430439'}
2026-01-22 03:04:52,773 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 03:04:52,779 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1556214966947168426', 'uuid-lslong': '13512581332440913425'}, 'enable': 'true', 'created': '2026-01-22T03:04:52', 'last-modified': '2026-01-22T03:04:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.432455'}
2026-01-22 03:04:52,786 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 03:04:52,792 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1556214966947168426', 'uuid-lslong': '13512581332440913425'}, 'enable': 'true', 'created': '2026-01-22T03:04:52', 'last-modified': '2026-01-22T03:04:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.454799'}
2026-01-22 03:04:52,798 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 03:04:52,798 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-46807250 passed
2026-01-22 03:04:52,798 - DEBUG - ====Verifying policy data for ctest-left_vn-46807250 in API_Server ======
2026-01-22 03:04:52,799 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:04:52,806 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:04:52,818 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:04:52,913 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1598c944-6b08-40aa-bb86-55210eb71611
2026-01-22 03:04:52,926 - DEBUG - =>VN ctest-left_vn-46807250 has no policy to be verified
2026-01-22 03:04:52,926 - DEBUG - Verifying the vn in opserver
2026-01-22 03:04:52,926 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250 virtual network link through opserver 10.0.0.38
2026-01-22 03:04:52,926 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:04:52,941 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250?flat'}
2026-01-22 03:04:52,941 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250 virtual network link through opserver 10.0.0.50
2026-01-22 03:04:52,941 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:04:52,956 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250?flat'}
2026-01-22 03:04:52,956 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250 virtual network link through opserver 10.0.0.131
2026-01-22 03:04:52,956 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:04:52,970 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250?flat'}
2026-01-22 03:04:52,970 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-61409174:ctest-left_vn-46807250 is found in opserver
2026-01-22 03:04:52,991 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 03:04:53,003 - DEBUG - VRF ids for VN ctest-left_vn-46807250: {}
2026-01-22 03:04:53,304 - DEBUG - Response for create_network : {'network': {'id': 'c1dd7056-762e-463e-8a33-6b53adf64c6c', 'name': 'ctest-right_vn-39947461', 'tenant_id': '77691a6484024416a296662aaca130b2', 'project_id': '77691a6484024416a296662aaca130b2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-39947461'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:04:53,551 - DEBUG - Response for create_subnet : {'subnet': {'id': 'caea1639-4fdd-4965-82fc-3075b9f01788', 'name': '', 'tenant_id': '77691a6484024416a296662aaca130b2', 'network_id': 'c1dd7056-762e-463e-8a33-6b53adf64c6c', 'ip_version': 4, 'cidr': '147.244.150.192/26', 'allocation_pools': [{'start': '147.244.150.194', 'end': '147.244.150.254'}], 'gateway_ip': '147.244.150.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '147.244.150.194', 'tags': [], 'project_id': '77691a6484024416a296662aaca130b2'}}
2026-01-22 03:04:53,574 - INFO - Created VN ctest-right_vn-39947461
2026-01-22 03:04:53,586 - DEBUG - VN ctest-right_vn-39947461 UUID is c1dd7056-762e-463e-8a33-6b53adf64c6c
2026-01-22 03:04:53,670 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:04:53,676 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:04:53,687 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:04:53,788 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c1dd7056-762e-463e-8a33-6b53adf64c6c
2026-01-22 03:04:53,800 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c1dd7056-762e-463e-8a33-6b53adf64c6c
2026-01-22 03:04:53,810 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/0834b9e1-d915-4348-97c6-41322caba894
2026-01-22 03:04:53,818 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/0834b9e1-d915-4348-97c6-41322caba894
2026-01-22 03:04:53,826 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/69ef33ff-f1e8-4fe0-8e34-bd302db39711
2026-01-22 03:04:53,833 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:04:53,833 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c1dd7056-762e-463e-8a33-6b53adf64c6c
2026-01-22 03:04:53,844 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/0834b9e1-d915-4348-97c6-41322caba894
2026-01-22 03:04:53,859 - INFO - Verified VN network id 14 for VN c1dd7056-762e-463e-8a33-6b53adf64c6c
2026-01-22 03:04:53,860 - INFO - Verifications in API Server for VN ctest-right_vn-39947461 passed
2026-01-22 03:04:53,860 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c1dd7056-762e-463e-8a33-6b53adf64c6c
2026-01-22 03:04:53,869 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/0834b9e1-d915-4348-97c6-41322caba894
2026-01-22 03:04:53,879 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/0834b9e1-d915-4348-97c6-41322caba894
2026-01-22 03:04:53,887 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/69ef33ff-f1e8-4fe0-8e34-bd302db39711
2026-01-22 03:04:53,901 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13969445135825389118', 'uuid-lslong': '9958421208191356012'}, 'enable': 'true', 'created': '2026-01-22T03:04:53', 'last-modified': '2026-01-22T03:04:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416696'}
2026-01-22 03:04:53,908 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:04:53,914 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13969445135825389118', 'uuid-lslong': '9958421208191356012'}, 'enable': 'true', 'created': '2026-01-22T03:04:53', 'last-modified': '2026-01-22T03:04:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.431463'}
2026-01-22 03:04:53,920 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:04:53,926 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13969445135825389118', 'uuid-lslong': '9958421208191356012'}, 'enable': 'true', 'created': '2026-01-22T03:04:53', 'last-modified': '2026-01-22T03:04:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.445040'}
2026-01-22 03:04:53,933 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:04:53,933 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-39947461 passed
2026-01-22 03:04:53,933 - DEBUG - ====Verifying policy data for ctest-right_vn-39947461 in API_Server ======
2026-01-22 03:04:53,933 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:04:53,941 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:04:53,956 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:04:54,054 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c1dd7056-762e-463e-8a33-6b53adf64c6c
2026-01-22 03:04:54,063 - DEBUG - =>VN ctest-right_vn-39947461 has no policy to be verified
2026-01-22 03:04:54,063 - DEBUG - Verifying the vn in opserver
2026-01-22 03:04:54,063 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461 virtual network link through opserver 10.0.0.38
2026-01-22 03:04:54,063 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:04:54,076 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461?flat'}
2026-01-22 03:04:54,076 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461 virtual network link through opserver 10.0.0.50
2026-01-22 03:04:54,076 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:04:54,091 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461?flat'}
2026-01-22 03:04:54,091 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461 virtual network link through opserver 10.0.0.131
2026-01-22 03:04:54,091 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:04:54,105 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461?flat'}
2026-01-22 03:04:54,105 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-61409174:ctest-right_vn-39947461 is found in opserver
2026-01-22 03:04:54,127 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 03:04:54,136 - DEBUG - VRF ids for VN ctest-right_vn-39947461: {}
2026-01-22 03:04:54,408 - DEBUG - Response for create_network : {'network': {'id': 'deb50f9e-5ed9-47b6-8827-3a3bdb135044', 'name': 'ctest-trans_left_vn-15077047', 'tenant_id': '77691a6484024416a296662aaca130b2', 'project_id': '77691a6484024416a296662aaca130b2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-trans_left_vn-15077047'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:04:54,628 - DEBUG - Response for create_subnet : {'subnet': {'id': '4e3128d9-cdfd-4335-a335-28345997c91d', 'name': '', 'tenant_id': '77691a6484024416a296662aaca130b2', 'network_id': 'deb50f9e-5ed9-47b6-8827-3a3bdb135044', 'ip_version': 4, 'cidr': '26.219.194.192/26', 'allocation_pools': [{'start': '26.219.194.194', 'end': '26.219.194.254'}], 'gateway_ip': '26.219.194.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '26.219.194.194', 'tags': [], 'project_id': '77691a6484024416a296662aaca130b2'}}
2026-01-22 03:04:54,649 - INFO - Created VN ctest-trans_left_vn-15077047
2026-01-22 03:04:54,662 - DEBUG - VN ctest-trans_left_vn-15077047 UUID is deb50f9e-5ed9-47b6-8827-3a3bdb135044
2026-01-22 03:04:54,739 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:04:54,745 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:04:54,757 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:04:54,853 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/deb50f9e-5ed9-47b6-8827-3a3bdb135044
2026-01-22 03:04:54,865 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/deb50f9e-5ed9-47b6-8827-3a3bdb135044
2026-01-22 03:04:54,874 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/42668bc6-4142-4d89-b902-2c60a368598b
2026-01-22 03:04:54,883 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/42668bc6-4142-4d89-b902-2c60a368598b
2026-01-22 03:04:54,892 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/2b12c3ab-eb0e-477b-ae09-d2caac8631ed
2026-01-22 03:04:54,899 - DEBUG - Route Targets: ['target:64512:8000008']
2026-01-22 03:04:54,899 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/deb50f9e-5ed9-47b6-8827-3a3bdb135044
2026-01-22 03:04:54,908 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/42668bc6-4142-4d89-b902-2c60a368598b
2026-01-22 03:04:54,924 - INFO - Verified VN network id 16 for VN deb50f9e-5ed9-47b6-8827-3a3bdb135044
2026-01-22 03:04:54,924 - INFO - Verifications in API Server for VN ctest-trans_left_vn-15077047 passed
2026-01-22 03:04:54,925 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/deb50f9e-5ed9-47b6-8827-3a3bdb135044
2026-01-22 03:04:54,935 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/42668bc6-4142-4d89-b902-2c60a368598b
2026-01-22 03:04:54,941 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/42668bc6-4142-4d89-b902-2c60a368598b
2026-01-22 03:04:54,948 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/2b12c3ab-eb0e-477b-ae09-d2caac8631ed
2026-01-22 03:04:54,959 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16047750020075177910', 'uuid-lslong': '9810874342002872388'}, 'enable': 'true', 'created': '2026-01-22T03:04:54', 'last-modified': '2026-01-22T03:04:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.379784'}
2026-01-22 03:04:54,964 - DEBUG - Route Targets: ['target:64512:8000008']
2026-01-22 03:04:54,971 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16047750020075177910', 'uuid-lslong': '9810874342002872388'}, 'enable': 'true', 'created': '2026-01-22T03:04:54', 'last-modified': '2026-01-22T03:04:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.388743'}
2026-01-22 03:04:54,977 - DEBUG - Route Targets: ['target:64512:8000008']
2026-01-22 03:04:54,982 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16047750020075177910', 'uuid-lslong': '9810874342002872388'}, 'enable': 'true', 'created': '2026-01-22T03:04:54', 'last-modified': '2026-01-22T03:04:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.401807'}
2026-01-22 03:04:54,988 - DEBUG - Route Targets: ['target:64512:8000008']
2026-01-22 03:04:54,988 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-15077047 passed
2026-01-22 03:04:54,989 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-15077047 in API_Server ======
2026-01-22 03:04:54,989 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:04:54,995 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:04:55,007 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:04:55,102 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/deb50f9e-5ed9-47b6-8827-3a3bdb135044
2026-01-22 03:04:55,116 - DEBUG - =>VN ctest-trans_left_vn-15077047 has no policy to be verified
2026-01-22 03:04:55,116 - DEBUG - Verifying the vn in opserver
2026-01-22 03:04:55,116 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047 virtual network link through opserver 10.0.0.38
2026-01-22 03:04:55,116 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:04:55,128 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047?flat'}
2026-01-22 03:04:55,128 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047 virtual network link through opserver 10.0.0.50
2026-01-22 03:04:55,128 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:04:55,145 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047?flat'}
2026-01-22 03:04:55,145 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047 virtual network link through opserver 10.0.0.131
2026-01-22 03:04:55,145 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:04:55,157 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047?flat'}
2026-01-22 03:04:55,157 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-61409174:ctest-trans_left_vn-15077047 is found in opserver
2026-01-22 03:04:55,180 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 03:04:55,191 - DEBUG - VRF ids for VN ctest-trans_left_vn-15077047: {}
2026-01-22 03:04:55,449 - DEBUG - Response for create_network : {'network': {'id': '2309022c-d39c-4708-9787-76dcd0d138b6', 'name': 'ctest-trans_right_vn-77228920', 'tenant_id': '77691a6484024416a296662aaca130b2', 'project_id': '77691a6484024416a296662aaca130b2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-trans_right_vn-77228920'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:04:55,667 - DEBUG - Response for create_subnet : {'subnet': {'id': '8ce5fb78-390f-47af-93ef-2f4c54c5fb5f', 'name': '', 'tenant_id': '77691a6484024416a296662aaca130b2', 'network_id': '2309022c-d39c-4708-9787-76dcd0d138b6', 'ip_version': 4, 'cidr': '42.50.253.64/26', 'allocation_pools': [{'start': '42.50.253.66', 'end': '42.50.253.126'}], 'gateway_ip': '42.50.253.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '42.50.253.66', 'tags': [], 'project_id': '77691a6484024416a296662aaca130b2'}}
2026-01-22 03:04:55,694 - INFO - Created VN ctest-trans_right_vn-77228920
2026-01-22 03:04:55,705 - DEBUG - VN ctest-trans_right_vn-77228920 UUID is 2309022c-d39c-4708-9787-76dcd0d138b6
2026-01-22 03:04:55,779 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:04:55,786 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:04:55,800 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:04:55,897 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2309022c-d39c-4708-9787-76dcd0d138b6
2026-01-22 03:04:55,910 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2309022c-d39c-4708-9787-76dcd0d138b6
2026-01-22 03:04:55,920 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1a07eb5f-d95e-4d9d-9b9f-c4dc8f840869
2026-01-22 03:04:55,931 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1a07eb5f-d95e-4d9d-9b9f-c4dc8f840869
2026-01-22 03:04:55,939 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/399e7795-86bb-4467-941f-92fe2a790288
2026-01-22 03:04:55,945 - DEBUG - Route Targets: ['target:64512:8000009']
2026-01-22 03:04:55,945 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2309022c-d39c-4708-9787-76dcd0d138b6
2026-01-22 03:04:55,957 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1a07eb5f-d95e-4d9d-9b9f-c4dc8f840869
2026-01-22 03:04:55,975 - INFO - Verified VN network id 17 for VN 2309022c-d39c-4708-9787-76dcd0d138b6
2026-01-22 03:04:55,975 - INFO - Verifications in API Server for VN ctest-trans_right_vn-77228920 passed
2026-01-22 03:04:55,976 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2309022c-d39c-4708-9787-76dcd0d138b6
2026-01-22 03:04:55,991 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1a07eb5f-d95e-4d9d-9b9f-c4dc8f840869
2026-01-22 03:04:56,002 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1a07eb5f-d95e-4d9d-9b9f-c4dc8f840869
2026-01-22 03:04:56,013 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/399e7795-86bb-4467-941f-92fe2a790288
2026-01-22 03:04:56,027 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2524551457669924616', 'uuid-lslong': '10918826512351312054'}, 'enable': 'true', 'created': '2026-01-22T03:04:55', 'last-modified': '2026-01-22T03:04:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.417881'}
2026-01-22 03:04:56,040 - DEBUG - Route Targets: ['target:64512:8000009']
2026-01-22 03:04:56,046 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2524551457669924616', 'uuid-lslong': '10918826512351312054'}, 'enable': 'true', 'created': '2026-01-22T03:04:55', 'last-modified': '2026-01-22T03:04:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.433267'}
2026-01-22 03:04:56,052 - DEBUG - Route Targets: ['target:64512:8000009']
2026-01-22 03:04:56,057 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-61409174', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2524551457669924616', 'uuid-lslong': '10918826512351312054'}, 'enable': 'true', 'created': '2026-01-22T03:04:55', 'last-modified': '2026-01-22T03:04:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.450505'}
2026-01-22 03:04:56,064 - DEBUG - Route Targets: ['target:64512:8000009']
2026-01-22 03:04:56,064 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-77228920 passed
2026-01-22 03:04:56,064 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-77228920 in API_Server ======
2026-01-22 03:04:56,064 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:04:56,072 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:04:56,088 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:04:56,201 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2309022c-d39c-4708-9787-76dcd0d138b6
2026-01-22 03:04:56,212 - DEBUG - =>VN ctest-trans_right_vn-77228920 has no policy to be verified
2026-01-22 03:04:56,212 - DEBUG - Verifying the vn in opserver
2026-01-22 03:04:56,212 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920 virtual network link through opserver 10.0.0.38
2026-01-22 03:04:56,212 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:04:56,227 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920?flat'}
2026-01-22 03:04:56,227 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920 virtual network link through opserver 10.0.0.50
2026-01-22 03:04:56,227 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:04:56,242 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920?flat'}
2026-01-22 03:04:56,242 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920 virtual network link through opserver 10.0.0.131
2026-01-22 03:04:56,242 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:04:56,255 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920?flat'}
2026-01-22 03:04:56,255 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-61409174:ctest-trans_right_vn-77228920 is found in opserver
2026-01-22 03:04:56,276 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 03:04:56,286 - DEBUG - VRF ids for VN ctest-trans_right_vn-77228920: {}
2026-01-22 03:04:57,524 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-1)
2026-01-22 03:04:58,865 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-2)
2026-01-22 03:04:58,865 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-61265761']
2026-01-22 03:04:59,175 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-61265761'] created succesfully
2026-01-22 03:04:59,509 - DEBUG - Image by name tiny_trans_fw not found
2026-01-22 03:04:59,509 - DEBUG - Installing image tiny_trans_fw
2026-01-22 03:04:59,509 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'}
2026-01-22 03:04:59,510 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz
2026-01-22 03:04:59,510 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz
2026-01-22 03:04:59,541 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz -O /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2026-01-22 03:04:59,568 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2026-01-22 03:04:59,569 - DEBUG - Unzip image
2026-01-22 03:04:59,569 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2026-01-22 03:04:59,588 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found
2026-01-22 03:04:59,588 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-61265761']
2026-01-22 03:04:59,694 - INFO - Service template: ['default-domain', 'ctest-service_template_1-61265761'] deleted successfully.
2026-01-22 03:04:59,695 - INFO - Skip interface_detach for VM ctest-right_vm-10732719 in state BUILD
2026-01-22 03:04:59,695 - INFO - Deleting VM ctest-right_vm-10732719
2026-01-22 03:04:59,695 - ERROR - VM ctest-right_vm-10732719 has failed to come up
2026-01-22 03:04:59,695 - ERROR - Nova failed to get host of the VM
2026-01-22 03:04:59,695 - ERROR - VM ctest-right_vm-10732719 has failed to come up
2026-01-22 03:04:59,695 - ERROR - Nova failed to get host of the VM
2026-01-22 03:04:59,772 - INFO - Skip interface_detach for VM ctest-left_vm-55154002 in state BUILD
2026-01-22 03:04:59,772 - INFO - Deleting VM ctest-left_vm-55154002
2026-01-22 03:04:59,772 - ERROR - VM ctest-left_vm-55154002 has failed to come up
2026-01-22 03:04:59,772 - ERROR - Nova failed to get host of the VM
2026-01-22 03:04:59,772 - ERROR - VM ctest-left_vm-55154002 has failed to come up
2026-01-22 03:04:59,772 - ERROR - Nova failed to get host of the VM
2026-01-22 03:04:59,840 - INFO - Deleting VN ctest-trans_right_vn-77228920
2026-01-22 03:05:00,066 - DEBUG - Response for deleting network ()
2026-01-22 03:05:00,066 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1a07eb5f-d95e-4d9d-9b9f-c4dc8f840869
2026-01-22 03:05:00,073 - DEBUG - Response Code: 404
2026-01-22 03:05:00,073 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:05:00,087 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:05:00,132 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:05:00,233 - INFO - Validated that VN ctest-trans_right_vn-77228920 is not found in API Server
2026-01-22 03:05:00,251 - DEBUG - VN ctest-trans_right_vn-77228920 is not present in Agent 10.0.0.23
2026-01-22 03:05:00,263 - DEBUG - VN ctest-trans_right_vn-77228920 is not present in Agent 10.0.0.141
2026-01-22 03:05:00,263 - INFO - Validated that VN ctest-trans_right_vn-77228920 is not in any agent
2026-01-22 03:05:00,297 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-77228920 info
2026-01-22 03:05:00,298 - INFO - Deleting VN ctest-trans_left_vn-15077047
2026-01-22 03:05:00,465 - DEBUG - Response for deleting network ()
2026-01-22 03:05:00,466 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/42668bc6-4142-4d89-b902-2c60a368598b
2026-01-22 03:05:00,473 - DEBUG - Response Code: 404
2026-01-22 03:05:00,473 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:05:00,495 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:05:00,513 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:05:00,622 - INFO - Validated that VN ctest-trans_left_vn-15077047 is not found in API Server
2026-01-22 03:05:00,682 - DEBUG - VN ctest-trans_left_vn-15077047 is not present in Agent 10.0.0.23
2026-01-22 03:05:00,726 - DEBUG - VN ctest-trans_left_vn-15077047 is not present in Agent 10.0.0.141
2026-01-22 03:05:00,726 - INFO - Validated that VN ctest-trans_left_vn-15077047 is not in any agent
2026-01-22 03:05:00,806 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-15077047 info
2026-01-22 03:05:00,806 - INFO - Deleting VN ctest-right_vn-39947461
2026-01-22 03:05:00,858 - DEBUG - VN c1dd7056-762e-463e-8a33-6b53adf64c6c still in use: Unable to complete operation on network c1dd7056-762e-463e-8a33-6b53adf64c6c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-e9d402ce-ee73-4ad7-8d9f-9db8eb5d7da1']
2026-01-22 03:05:00,858 - WARNING - Deleting VN ctest-right_vn-39947461 failed..Will retry
2026-01-22 03:05:03,080 - DEBUG - Response for deleting network ()
2026-01-22 03:05:03,080 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/0834b9e1-d915-4348-97c6-41322caba894
2026-01-22 03:05:03,087 - DEBUG - Response Code: 404
2026-01-22 03:05:03,087 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:05:03,096 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:05:03,111 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:05:03,231 - INFO - Validated that VN ctest-right_vn-39947461 is not found in API Server
2026-01-22 03:05:03,244 - DEBUG - VN ctest-right_vn-39947461 is not present in Agent 10.0.0.23
2026-01-22 03:05:03,256 - DEBUG - VN ctest-right_vn-39947461 is not present in Agent 10.0.0.141
2026-01-22 03:05:03,256 - INFO - Validated that VN ctest-right_vn-39947461 is not in any agent
2026-01-22 03:05:03,306 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-39947461 info
2026-01-22 03:05:03,306 - INFO - Deleting VN ctest-left_vn-46807250
2026-01-22 03:05:03,495 - DEBUG - Response for deleting network ()
2026-01-22 03:05:03,495 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/24f8598a-b715-4daf-a601-d0cbf237fed7
2026-01-22 03:05:03,502 - DEBUG - Response Code: 404
2026-01-22 03:05:03,502 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:05:03,511 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:05:03,539 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:05:03,663 - INFO - Validated that VN ctest-left_vn-46807250 is not found in API Server
2026-01-22 03:05:03,676 - DEBUG - VN ctest-left_vn-46807250 is not present in Agent 10.0.0.23
2026-01-22 03:05:03,691 - DEBUG - VN ctest-left_vn-46807250 is not present in Agent 10.0.0.141
2026-01-22 03:05:03,691 - INFO - Validated that VN ctest-left_vn-46807250 is not in any agent
2026-01-22 03:05:03,723 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-46807250 info
2026-01-22 03:05:03,723 - INFO - Deleting VN ctest-mgmt_vn-39507685
2026-01-22 03:05:03,979 - DEBUG - Response for deleting network ()
2026-01-22 03:05:03,979 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1fb8e714-6505-44a0-948c-e598d4a474c7
2026-01-22 03:05:03,992 - DEBUG - Response Code: 404
2026-01-22 03:05:03,992 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:05:04,003 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:05:04,019 - DEBUG - Requesting: http://10.0.0.38:8082/project/77691a64-8402-4416-a296-662aaca130b2
2026-01-22 03:05:04,124 - INFO - Validated that VN ctest-mgmt_vn-39507685 is not found in API Server
2026-01-22 03:05:04,134 - DEBUG - VN ctest-mgmt_vn-39507685 is not present in Agent 10.0.0.23
2026-01-22 03:05:04,145 - DEBUG - VN ctest-mgmt_vn-39507685 is not present in Agent 10.0.0.141
2026-01-22 03:05:04,145 - INFO - Validated that VN ctest-mgmt_vn-39507685 is not in any agent
2026-01-22 03:05:04,181 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-39507685 info
2026-01-22 03:05:05,512 - DEBUG - No XMPP flaps were noticed during the test
2026-01-22 03:05:05,512 - INFO -
2026-01-22 03:05:05,512 - INFO - END TEST : test_svc_v2_transparent_datapath : SKIPPED[0:00:17]
2026-01-22 03:05:05,512 - INFO - --------------------------------------------------------------------------------
2026-01-22 03:05:05,659 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:07,803 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:09,975 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:12,111 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:14,255 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:16,411 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:18,555 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:20,715 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:22,863 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:24,995 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:27,127 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:29,271 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:31,415 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:33,567 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:35,727 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:37,887 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:40,023 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:42,191 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:44,363 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:46,547 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:48,687 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:50,823 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:52,963 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:55,099 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:57,247 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:05:59,399 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:06:01,555 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:06:03,727 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:06:05,899 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:06:08,031 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:06:10,171 - WARNING - Project ctest-TestSvcRegr-61409174 still has VNs [{'to': ['default-domain', 'ctest-TestSvcRegr-61409174', 'ctest-right_vn-28730792'], 'uuid': 'f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787', 'href': 'http://10.0.0.131:8082/virtual-network/f95b1c38-3b3f-4af8-9a4b-eacbb5ac4787'}] before deletion
2026-01-22 03:06:10,171 - WARNING - One or more references still present, will not delete the project ctest-TestSvcRegr-61409174
2026-01-22 03:06:10,370 - INFO - Domain Default found not creating
2026-01-22 03:06:10,548 - INFO - Project ctest-TestSvcRegr-56761044 not found, creating it
2026-01-22 03:06:11,387 - INFO - Created Project:ctest-TestSvcRegr-56761044, ID : ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:13,101 - INFO - ================================================================================
2026-01-22 03:06:13,101 - INFO - STARTING TEST : test_svc_CEM_22032
2026-01-22 03:06:14,406 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.19': '0', '10.20.0.5': '0'}, '10.0.0.141': {'10.20.0.19': '0', '10.20.0.5': '1'}} with
2026-01-22 03:06:14,406 - INFO - Initial checks done. Running the testcase now
2026-01-22 03:06:14,406 - INFO -
2026-01-22 03:06:15,127 - DEBUG - Response for create_network : {'network': {'id': 'af0d8ff0-4b78-4d30-84dd-50fbf8ef7664', 'name': 'ctest-mgmt_vn-41396283', 'tenant_id': 'ead446900b03438cbfabeaea20b0a186', 'project_id': 'ead446900b03438cbfabeaea20b0a186', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-56761044', 'ctest-mgmt_vn-41396283'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:06:15,424 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fdd4e559-49c1-4e3c-be83-fad5fbf4ec4d', 'name': '', 'tenant_id': 'ead446900b03438cbfabeaea20b0a186', 'network_id': 'af0d8ff0-4b78-4d30-84dd-50fbf8ef7664', 'ip_version': 4, 'cidr': '111.202.198.192/26', 'allocation_pools': [{'start': '111.202.198.194', 'end': '111.202.198.254'}], 'gateway_ip': '111.202.198.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '111.202.198.194', 'tags': [], 'project_id': 'ead446900b03438cbfabeaea20b0a186'}}
2026-01-22 03:06:15,446 - INFO - Created VN ctest-mgmt_vn-41396283
2026-01-22 03:06:15,457 - DEBUG - VN ctest-mgmt_vn-41396283 UUID is af0d8ff0-4b78-4d30-84dd-50fbf8ef7664
2026-01-22 03:06:15,538 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:15,850 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:15,882 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:15,899 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:15,989 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/af0d8ff0-4b78-4d30-84dd-50fbf8ef7664
2026-01-22 03:06:16,004 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/af0d8ff0-4b78-4d30-84dd-50fbf8ef7664
2026-01-22 03:06:16,016 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/bc433c2e-8df7-4ef1-821e-1117d9f82f2b
2026-01-22 03:06:16,028 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/bc433c2e-8df7-4ef1-821e-1117d9f82f2b
2026-01-22 03:06:16,037 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/f6272549-7b2a-44f2-bc63-0397629a8d34
2026-01-22 03:06:16,044 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:06:16,045 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/af0d8ff0-4b78-4d30-84dd-50fbf8ef7664
2026-01-22 03:06:16,057 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/bc433c2e-8df7-4ef1-821e-1117d9f82f2b
2026-01-22 03:06:16,073 - INFO - Verified VN network id 12 for VN af0d8ff0-4b78-4d30-84dd-50fbf8ef7664
2026-01-22 03:06:16,073 - INFO - Verifications in API Server for VN ctest-mgmt_vn-41396283 passed
2026-01-22 03:06:16,074 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/af0d8ff0-4b78-4d30-84dd-50fbf8ef7664
2026-01-22 03:06:16,082 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/bc433c2e-8df7-4ef1-821e-1117d9f82f2b
2026-01-22 03:06:16,092 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/bc433c2e-8df7-4ef1-821e-1117d9f82f2b
2026-01-22 03:06:16,100 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/f6272549-7b2a-44f2-bc63-0397629a8d34
2026-01-22 03:06:16,112 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12613896393555725616', 'uuid-lslong': '9573897426002998884'}, 'enable': 'true', 'created': '2026-01-22T03:06:15', 'last-modified': '2026-01-22T03:06:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.736205'}
2026-01-22 03:06:16,117 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:06:16,123 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12613896393555725616', 'uuid-lslong': '9573897426002998884'}, 'enable': 'true', 'created': '2026-01-22T03:06:15', 'last-modified': '2026-01-22T03:06:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.743602'}
2026-01-22 03:06:16,128 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:06:16,134 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12613896393555725616', 'uuid-lslong': '9573897426002998884'}, 'enable': 'true', 'created': '2026-01-22T03:06:15', 'last-modified': '2026-01-22T03:06:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.761708'}
2026-01-22 03:06:16,139 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:06:16,139 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-41396283 passed
2026-01-22 03:06:16,139 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-41396283 in API_Server ======
2026-01-22 03:06:16,139 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:16,146 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:16,157 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:16,250 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/af0d8ff0-4b78-4d30-84dd-50fbf8ef7664
2026-01-22 03:06:16,259 - DEBUG - =>VN ctest-mgmt_vn-41396283 has no policy to be verified
2026-01-22 03:06:16,259 - DEBUG - Verifying the vn in opserver
2026-01-22 03:06:16,259 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283 virtual network link through opserver 10.0.0.38
2026-01-22 03:06:16,259 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:06:16,562 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:06:16,628 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283?flat'}
2026-01-22 03:06:16,628 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283 virtual network link through opserver 10.0.0.50
2026-01-22 03:06:16,628 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:06:16,949 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:06:17,016 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283?flat'}
2026-01-22 03:06:17,016 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283 virtual network link through opserver 10.0.0.131
2026-01-22 03:06:17,016 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:06:17,338 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:06:17,415 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283?flat'}
2026-01-22 03:06:17,415 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-41396283 is found in opserver
2026-01-22 03:06:17,439 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 03:06:17,448 - DEBUG - VRF ids for VN ctest-mgmt_vn-41396283: {}
2026-01-22 03:06:17,717 - DEBUG - Response for create_network : {'network': {'id': '670ff0ff-0d44-4ed9-8245-29ed6b662838', 'name': 'service-left-vn-33769520', 'tenant_id': 'ead446900b03438cbfabeaea20b0a186', 'project_id': 'ead446900b03438cbfabeaea20b0a186', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-56761044', 'service-left-vn-33769520'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:06:17,965 - DEBUG - Response for create_subnet : {'subnet': {'id': '0f186387-0c5a-442d-9862-6a5367193e68', 'name': '', 'tenant_id': 'ead446900b03438cbfabeaea20b0a186', 'network_id': '670ff0ff-0d44-4ed9-8245-29ed6b662838', 'ip_version': 4, 'cidr': '55.30.127.0/26', 'allocation_pools': [{'start': '55.30.127.2', 'end': '55.30.127.62'}], 'gateway_ip': '55.30.127.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '55.30.127.2', 'tags': [], 'project_id': 'ead446900b03438cbfabeaea20b0a186'}}
2026-01-22 03:06:17,990 - INFO - Created VN service-left-vn-33769520
2026-01-22 03:06:18,002 - DEBUG - VN service-left-vn-33769520 UUID is 670ff0ff-0d44-4ed9-8245-29ed6b662838
2026-01-22 03:06:18,082 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:18,089 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:18,103 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:18,206 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/670ff0ff-0d44-4ed9-8245-29ed6b662838
2026-01-22 03:06:18,227 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/670ff0ff-0d44-4ed9-8245-29ed6b662838
2026-01-22 03:06:18,238 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b3a016b3-f96f-4971-a528-6cae64e20cff
2026-01-22 03:06:18,245 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b3a016b3-f96f-4971-a528-6cae64e20cff
2026-01-22 03:06:18,253 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1dcabcce-b448-49a1-aa69-90600e7d4efc
2026-01-22 03:06:18,260 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 03:06:18,260 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/670ff0ff-0d44-4ed9-8245-29ed6b662838
2026-01-22 03:06:18,270 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b3a016b3-f96f-4971-a528-6cae64e20cff
2026-01-22 03:06:18,288 - INFO - Verified VN network id 13 for VN 670ff0ff-0d44-4ed9-8245-29ed6b662838
2026-01-22 03:06:18,288 - INFO - Verifications in API Server for VN service-left-vn-33769520 passed
2026-01-22 03:06:18,288 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/670ff0ff-0d44-4ed9-8245-29ed6b662838
2026-01-22 03:06:18,299 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b3a016b3-f96f-4971-a528-6cae64e20cff
2026-01-22 03:06:18,307 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b3a016b3-f96f-4971-a528-6cae64e20cff
2026-01-22 03:06:18,314 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1dcabcce-b448-49a1-aa69-90600e7d4efc
2026-01-22 03:06:18,324 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7426419288787144409', 'uuid-lslong': '9386955098009511992'}, 'enable': 'true', 'created': '2026-01-22T03:06:17', 'last-modified': '2026-01-22T03:06:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420575'}
2026-01-22 03:06:18,330 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 03:06:18,335 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7426419288787144409', 'uuid-lslong': '9386955098009511992'}, 'enable': 'true', 'created': '2026-01-22T03:06:17', 'last-modified': '2026-01-22T03:06:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.427978'}
2026-01-22 03:06:18,343 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 03:06:18,348 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7426419288787144409', 'uuid-lslong': '9386955098009511992'}, 'enable': 'true', 'created': '2026-01-22T03:06:17', 'last-modified': '2026-01-22T03:06:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444041'}
2026-01-22 03:06:18,355 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 03:06:18,355 - INFO - On all control nodes, Config, RI and RT verification for VN service-left-vn-33769520 passed
2026-01-22 03:06:18,355 - DEBUG - ====Verifying policy data for service-left-vn-33769520 in API_Server ======
2026-01-22 03:06:18,355 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:18,362 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:18,373 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:18,465 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/670ff0ff-0d44-4ed9-8245-29ed6b662838
2026-01-22 03:06:18,474 - DEBUG - =>VN service-left-vn-33769520 has no policy to be verified
2026-01-22 03:06:18,474 - DEBUG - Verifying the vn in opserver
2026-01-22 03:06:18,475 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520 virtual network link through opserver 10.0.0.38
2026-01-22 03:06:18,475 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:06:18,539 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520?flat'}
2026-01-22 03:06:18,540 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520 virtual network link through opserver 10.0.0.50
2026-01-22 03:06:18,540 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:06:18,612 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520?flat'}
2026-01-22 03:06:18,612 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520 virtual network link through opserver 10.0.0.131
2026-01-22 03:06:18,612 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:06:18,682 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520?flat'}
2026-01-22 03:06:18,682 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-56761044:service-left-vn-33769520 is found in opserver
2026-01-22 03:06:18,704 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 03:06:18,716 - DEBUG - VRF ids for VN service-left-vn-33769520: {}
2026-01-22 03:06:19,006 - DEBUG - Response for create_network : {'network': {'id': '7e4e2c72-8475-48b8-9677-78b44babff00', 'name': 'service-right-vn-04521574', 'tenant_id': 'ead446900b03438cbfabeaea20b0a186', 'project_id': 'ead446900b03438cbfabeaea20b0a186', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-56761044', 'service-right-vn-04521574'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:06:19,294 - DEBUG - Response for create_subnet : {'subnet': {'id': '75d34a03-9df2-4001-aa55-e46c3118bb35', 'name': '', 'tenant_id': 'ead446900b03438cbfabeaea20b0a186', 'network_id': '7e4e2c72-8475-48b8-9677-78b44babff00', 'ip_version': 4, 'cidr': '11.67.13.0/26', 'allocation_pools': [{'start': '11.67.13.2', 'end': '11.67.13.62'}], 'gateway_ip': '11.67.13.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.67.13.2', 'tags': [], 'project_id': 'ead446900b03438cbfabeaea20b0a186'}}
2026-01-22 03:06:19,315 - INFO - Created VN service-right-vn-04521574
2026-01-22 03:06:19,326 - DEBUG - VN service-right-vn-04521574 UUID is 7e4e2c72-8475-48b8-9677-78b44babff00
2026-01-22 03:06:19,397 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:19,413 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:19,429 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:19,521 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7e4e2c72-8475-48b8-9677-78b44babff00
2026-01-22 03:06:19,532 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7e4e2c72-8475-48b8-9677-78b44babff00
2026-01-22 03:06:19,543 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/153e6aad-306e-43d2-91b6-c53327c94370
2026-01-22 03:06:19,550 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/153e6aad-306e-43d2-91b6-c53327c94370
2026-01-22 03:06:19,557 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/eb8dc9ea-78b8-408b-b168-f1965cd800a2
2026-01-22 03:06:19,564 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:06:19,564 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7e4e2c72-8475-48b8-9677-78b44babff00
2026-01-22 03:06:19,576 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/153e6aad-306e-43d2-91b6-c53327c94370
2026-01-22 03:06:19,592 - INFO - Verified VN network id 14 for VN 7e4e2c72-8475-48b8-9677-78b44babff00
2026-01-22 03:06:19,592 - INFO - Verifications in API Server for VN service-right-vn-04521574 passed
2026-01-22 03:06:19,592 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7e4e2c72-8475-48b8-9677-78b44babff00
2026-01-22 03:06:19,602 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/153e6aad-306e-43d2-91b6-c53327c94370
2026-01-22 03:06:19,610 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/153e6aad-306e-43d2-91b6-c53327c94370
2026-01-22 03:06:19,620 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/eb8dc9ea-78b8-408b-b168-f1965cd800a2
2026-01-22 03:06:19,631 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9101260767322523832', 'uuid-lslong': '10842267343676768000'}, 'enable': 'true', 'created': '2026-01-22T03:06:18', 'last-modified': '2026-01-22T03:06:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405751'}
2026-01-22 03:06:19,636 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:06:19,643 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9101260767322523832', 'uuid-lslong': '10842267343676768000'}, 'enable': 'true', 'created': '2026-01-22T03:06:18', 'last-modified': '2026-01-22T03:06:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416819'}
2026-01-22 03:06:19,650 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:06:19,655 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9101260767322523832', 'uuid-lslong': '10842267343676768000'}, 'enable': 'true', 'created': '2026-01-22T03:06:18', 'last-modified': '2026-01-22T03:06:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.425839'}
2026-01-22 03:06:19,661 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:06:19,661 - INFO - On all control nodes, Config, RI and RT verification for VN service-right-vn-04521574 passed
2026-01-22 03:06:19,661 - DEBUG - ====Verifying policy data for service-right-vn-04521574 in API_Server ======
2026-01-22 03:06:19,661 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:19,667 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:19,677 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:19,770 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7e4e2c72-8475-48b8-9677-78b44babff00
2026-01-22 03:06:19,780 - DEBUG - =>VN service-right-vn-04521574 has no policy to be verified
2026-01-22 03:06:19,780 - DEBUG - Verifying the vn in opserver
2026-01-22 03:06:19,780 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574 virtual network link through opserver 10.0.0.38
2026-01-22 03:06:19,780 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:06:19,844 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574?flat'}
2026-01-22 03:06:19,844 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574 virtual network link through opserver 10.0.0.50
2026-01-22 03:06:19,844 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:06:19,903 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574?flat'}
2026-01-22 03:06:19,903 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574 virtual network link through opserver 10.0.0.131
2026-01-22 03:06:19,903 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:06:19,969 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574?flat'}
2026-01-22 03:06:19,969 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-56761044:service-right-vn-04521574 is found in opserver
2026-01-22 03:06:19,989 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 03:06:19,999 - DEBUG - VRF ids for VN service-right-vn-04521574: {}
2026-01-22 03:06:20,154 - DEBUG - Services list from nova: [, , , ]
2026-01-22 03:06:21,268 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-1)
2026-01-22 03:06:22,530 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-2)
2026-01-22 03:06:22,530 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-27020781']
2026-01-22 03:06:22,821 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-27020781'] created succesfully
2026-01-22 03:06:23,227 - DEBUG - Image by name tiny_nat_fw not found
2026-01-22 03:06:23,227 - DEBUG - Installing image tiny_nat_fw
2026-01-22 03:06:23,227 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2026-01-22 03:06:23,228 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2026-01-22 03:06:23,228 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2026-01-22 03:06:23,228 - DEBUG - Unzip image
2026-01-22 03:06:23,228 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2026-01-22 03:06:23,254 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2026-01-22 03:06:23,254 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-27020781']
2026-01-22 03:06:23,342 - INFO - Service template: ['default-domain', 'ctest-service_template_1-27020781'] deleted successfully.
2026-01-22 03:06:23,343 - INFO - Skip interface_detach for VM ctest-right_vm-84773294 in state BUILD
2026-01-22 03:06:23,343 - INFO - Deleting VM ctest-right_vm-84773294
2026-01-22 03:06:23,379 - ERROR - VM ctest-right_vm-84773294 has failed to come up
2026-01-22 03:06:23,379 - ERROR - Nova failed to get host of the VM
2026-01-22 03:06:23,379 - ERROR - VM ctest-right_vm-84773294 has failed to come up
2026-01-22 03:06:23,379 - ERROR - Nova failed to get host of the VM
2026-01-22 03:06:23,498 - INFO - Skip interface_detach for VM ctest-left_vm-26818297 in state BUILD
2026-01-22 03:06:23,498 - INFO - Deleting VM ctest-left_vm-26818297
2026-01-22 03:06:23,498 - ERROR - VM ctest-left_vm-26818297 has failed to come up
2026-01-22 03:06:23,498 - ERROR - Nova failed to get host of the VM
2026-01-22 03:06:23,498 - ERROR - VM ctest-left_vm-26818297 has failed to come up
2026-01-22 03:06:23,498 - ERROR - Nova failed to get host of the VM
2026-01-22 03:06:23,577 - INFO - Deleting VN service-right-vn-04521574
2026-01-22 03:06:23,626 - DEBUG - VN 7e4e2c72-8475-48b8-9677-78b44babff00 still in use: Unable to complete operation on network 7e4e2c72-8475-48b8-9677-78b44babff00. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-6763d6f5-a35c-48c4-b1f5-13d678ae222e']
2026-01-22 03:06:23,627 - WARNING - Deleting VN service-right-vn-04521574 failed..Will retry
2026-01-22 03:06:25,887 - DEBUG - Response for deleting network ()
2026-01-22 03:06:25,887 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/153e6aad-306e-43d2-91b6-c53327c94370
2026-01-22 03:06:25,893 - DEBUG - Response Code: 404
2026-01-22 03:06:25,893 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:25,899 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:25,957 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:26,056 - INFO - Validated that VN service-right-vn-04521574 is not found in API Server
2026-01-22 03:06:26,070 - DEBUG - VN service-right-vn-04521574 is not present in Agent 10.0.0.23
2026-01-22 03:06:26,082 - DEBUG - VN service-right-vn-04521574 is not present in Agent 10.0.0.141
2026-01-22 03:06:26,082 - INFO - Validated that VN service-right-vn-04521574 is not in any agent
2026-01-22 03:06:26,110 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-right-vn-04521574 info
2026-01-22 03:06:26,110 - INFO - Deleting VN service-left-vn-33769520
2026-01-22 03:06:26,285 - DEBUG - Response for deleting network ()
2026-01-22 03:06:26,285 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b3a016b3-f96f-4971-a528-6cae64e20cff
2026-01-22 03:06:26,295 - DEBUG - Response Code: 404
2026-01-22 03:06:26,295 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:26,312 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:26,369 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:26,463 - INFO - Validated that VN service-left-vn-33769520 is not found in API Server
2026-01-22 03:06:26,474 - DEBUG - VN service-left-vn-33769520 is not present in Agent 10.0.0.23
2026-01-22 03:06:26,484 - DEBUG - VN service-left-vn-33769520 is not present in Agent 10.0.0.141
2026-01-22 03:06:26,484 - INFO - Validated that VN service-left-vn-33769520 is not in any agent
2026-01-22 03:06:26,514 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-left-vn-33769520 info
2026-01-22 03:06:26,514 - INFO - Deleting VN ctest-mgmt_vn-41396283
2026-01-22 03:06:26,676 - DEBUG - Response for deleting network ()
2026-01-22 03:06:26,676 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/bc433c2e-8df7-4ef1-821e-1117d9f82f2b
2026-01-22 03:06:26,686 - DEBUG - Response Code: 404
2026-01-22 03:06:26,687 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:26,696 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:26,707 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:26,800 - INFO - Validated that VN ctest-mgmt_vn-41396283 is not found in API Server
2026-01-22 03:06:26,811 - DEBUG - VN ctest-mgmt_vn-41396283 is not present in Agent 10.0.0.23
2026-01-22 03:06:26,820 - DEBUG - VN ctest-mgmt_vn-41396283 is not present in Agent 10.0.0.141
2026-01-22 03:06:26,820 - INFO - Validated that VN ctest-mgmt_vn-41396283 is not in any agent
2026-01-22 03:06:26,851 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-41396283 info
2026-01-22 03:06:28,139 - DEBUG - No XMPP flaps were noticed during the test
2026-01-22 03:06:28,139 - INFO -
2026-01-22 03:06:28,139 - INFO - END TEST : test_svc_CEM_22032 : SKIPPED[0:00:15]
2026-01-22 03:06:28,139 - INFO - --------------------------------------------------------------------------------
2026-01-22 03:06:28,145 - INFO - ================================================================================
2026-01-22 03:06:28,145 - INFO - STARTING TEST : test_svc_in_network_datapath
2026-01-22 03:06:29,430 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.19': '0', '10.20.0.5': '0'}, '10.0.0.141': {'10.20.0.19': '0', '10.20.0.5': '1'}} with
2026-01-22 03:06:29,430 - INFO - Initial checks done. Running the testcase now
2026-01-22 03:06:29,430 - INFO -
2026-01-22 03:06:29,710 - DEBUG - Response for create_network : {'network': {'id': '0bc43b3b-7437-4abd-b83e-785569950d8e', 'name': 'ctest-mgmt_vn-70154836', 'tenant_id': 'ead446900b03438cbfabeaea20b0a186', 'project_id': 'ead446900b03438cbfabeaea20b0a186', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-56761044', 'ctest-mgmt_vn-70154836'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:06:29,952 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd9a015b0-770d-41d9-85a9-03fa26f00fcf', 'name': '', 'tenant_id': 'ead446900b03438cbfabeaea20b0a186', 'network_id': '0bc43b3b-7437-4abd-b83e-785569950d8e', 'ip_version': 4, 'cidr': '183.185.47.128/26', 'allocation_pools': [{'start': '183.185.47.130', 'end': '183.185.47.190'}], 'gateway_ip': '183.185.47.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '183.185.47.130', 'tags': [], 'project_id': 'ead446900b03438cbfabeaea20b0a186'}}
2026-01-22 03:06:29,972 - INFO - Created VN ctest-mgmt_vn-70154836
2026-01-22 03:06:29,982 - DEBUG - VN ctest-mgmt_vn-70154836 UUID is 0bc43b3b-7437-4abd-b83e-785569950d8e
2026-01-22 03:06:30,055 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:30,061 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:30,072 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:30,163 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0bc43b3b-7437-4abd-b83e-785569950d8e
2026-01-22 03:06:30,175 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0bc43b3b-7437-4abd-b83e-785569950d8e
2026-01-22 03:06:30,184 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9d4dc7c2-eed5-4c92-b616-08a81734b38a
2026-01-22 03:06:30,194 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9d4dc7c2-eed5-4c92-b616-08a81734b38a
2026-01-22 03:06:30,201 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/ebcc6937-8688-473c-864d-361c0ffe7ffd
2026-01-22 03:06:30,207 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:06:30,208 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0bc43b3b-7437-4abd-b83e-785569950d8e
2026-01-22 03:06:30,217 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9d4dc7c2-eed5-4c92-b616-08a81734b38a
2026-01-22 03:06:30,232 - INFO - Verified VN network id 12 for VN 0bc43b3b-7437-4abd-b83e-785569950d8e
2026-01-22 03:06:30,233 - INFO - Verifications in API Server for VN ctest-mgmt_vn-70154836 passed
2026-01-22 03:06:30,233 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0bc43b3b-7437-4abd-b83e-785569950d8e
2026-01-22 03:06:30,242 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9d4dc7c2-eed5-4c92-b616-08a81734b38a
2026-01-22 03:06:30,249 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9d4dc7c2-eed5-4c92-b616-08a81734b38a
2026-01-22 03:06:30,258 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/ebcc6937-8688-473c-864d-361c0ffe7ffd
2026-01-22 03:06:30,271 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '847867756391385789', 'uuid-lslong': '13276181059773730190'}, 'enable': 'true', 'created': '2026-01-22T03:06:29', 'last-modified': '2026-01-22T03:06:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.369404'}
2026-01-22 03:06:30,279 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:06:30,286 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '847867756391385789', 'uuid-lslong': '13276181059773730190'}, 'enable': 'true', 'created': '2026-01-22T03:06:29', 'last-modified': '2026-01-22T03:06:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.382535'}
2026-01-22 03:06:30,294 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:06:30,299 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '847867756391385789', 'uuid-lslong': '13276181059773730190'}, 'enable': 'true', 'created': '2026-01-22T03:06:29', 'last-modified': '2026-01-22T03:06:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.395716'}
2026-01-22 03:06:30,305 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:06:30,305 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-70154836 passed
2026-01-22 03:06:30,305 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-70154836 in API_Server ======
2026-01-22 03:06:30,305 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:30,314 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:30,326 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:30,424 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0bc43b3b-7437-4abd-b83e-785569950d8e
2026-01-22 03:06:30,434 - DEBUG - =>VN ctest-mgmt_vn-70154836 has no policy to be verified
2026-01-22 03:06:30,434 - DEBUG - Verifying the vn in opserver
2026-01-22 03:06:30,434 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836 virtual network link through opserver 10.0.0.38
2026-01-22 03:06:30,435 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:06:30,448 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836?flat'}
2026-01-22 03:06:30,448 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836 virtual network link through opserver 10.0.0.50
2026-01-22 03:06:30,448 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:06:30,464 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836?flat'}
2026-01-22 03:06:30,464 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836 virtual network link through opserver 10.0.0.131
2026-01-22 03:06:30,464 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:06:30,477 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836?flat'}
2026-01-22 03:06:30,477 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-56761044:ctest-mgmt_vn-70154836 is found in opserver
2026-01-22 03:06:30,507 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 03:06:30,524 - DEBUG - VRF ids for VN ctest-mgmt_vn-70154836: {}
2026-01-22 03:06:30,822 - DEBUG - Response for create_network : {'network': {'id': 'a570d0a7-7deb-4721-83e7-f2b3606059fc', 'name': 'ctest-left_vn-62075732', 'tenant_id': 'ead446900b03438cbfabeaea20b0a186', 'project_id': 'ead446900b03438cbfabeaea20b0a186', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-56761044', 'ctest-left_vn-62075732'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:06:31,059 - DEBUG - Response for create_subnet : {'subnet': {'id': '802f6786-cc28-4a26-998b-09bc4abf093e', 'name': '', 'tenant_id': 'ead446900b03438cbfabeaea20b0a186', 'network_id': 'a570d0a7-7deb-4721-83e7-f2b3606059fc', 'ip_version': 4, 'cidr': '32.75.21.128/26', 'allocation_pools': [{'start': '32.75.21.130', 'end': '32.75.21.190'}], 'gateway_ip': '32.75.21.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '32.75.21.130', 'tags': [], 'project_id': 'ead446900b03438cbfabeaea20b0a186'}}
2026-01-22 03:06:31,081 - INFO - Created VN ctest-left_vn-62075732
2026-01-22 03:06:31,094 - DEBUG - VN ctest-left_vn-62075732 UUID is a570d0a7-7deb-4721-83e7-f2b3606059fc
2026-01-22 03:06:31,164 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:31,174 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:31,186 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:31,280 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a570d0a7-7deb-4721-83e7-f2b3606059fc
2026-01-22 03:06:31,293 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a570d0a7-7deb-4721-83e7-f2b3606059fc
2026-01-22 03:06:31,302 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/31f7807d-4cbc-4d62-80af-1b85e8908b1a
2026-01-22 03:06:31,311 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/31f7807d-4cbc-4d62-80af-1b85e8908b1a
2026-01-22 03:06:31,318 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/f6157a7a-fff0-40b0-bb34-9a02da7d8895
2026-01-22 03:06:31,326 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 03:06:31,327 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a570d0a7-7deb-4721-83e7-f2b3606059fc
2026-01-22 03:06:31,338 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/31f7807d-4cbc-4d62-80af-1b85e8908b1a
2026-01-22 03:06:31,353 - INFO - Verified VN network id 13 for VN a570d0a7-7deb-4721-83e7-f2b3606059fc
2026-01-22 03:06:31,353 - INFO - Verifications in API Server for VN ctest-left_vn-62075732 passed
2026-01-22 03:06:31,353 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a570d0a7-7deb-4721-83e7-f2b3606059fc
2026-01-22 03:06:31,363 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/31f7807d-4cbc-4d62-80af-1b85e8908b1a
2026-01-22 03:06:31,371 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/31f7807d-4cbc-4d62-80af-1b85e8908b1a
2026-01-22 03:06:31,378 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/f6157a7a-fff0-40b0-bb34-9a02da7d8895
2026-01-22 03:06:31,390 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11921257631440389921', 'uuid-lslong': '9504832390818716156'}, 'enable': 'true', 'created': '2026-01-22T03:06:30', 'last-modified': '2026-01-22T03:06:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.390666'}
2026-01-22 03:06:31,397 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 03:06:31,402 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11921257631440389921', 'uuid-lslong': '9504832390818716156'}, 'enable': 'true', 'created': '2026-01-22T03:06:30', 'last-modified': '2026-01-22T03:06:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.397564'}
2026-01-22 03:06:31,409 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 03:06:31,414 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11921257631440389921', 'uuid-lslong': '9504832390818716156'}, 'enable': 'true', 'created': '2026-01-22T03:06:30', 'last-modified': '2026-01-22T03:06:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.412517'}
2026-01-22 03:06:31,420 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 03:06:31,420 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-62075732 passed
2026-01-22 03:06:31,420 - DEBUG - ====Verifying policy data for ctest-left_vn-62075732 in API_Server ======
2026-01-22 03:06:31,421 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:31,427 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:31,438 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:31,537 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a570d0a7-7deb-4721-83e7-f2b3606059fc
2026-01-22 03:06:31,549 - DEBUG - =>VN ctest-left_vn-62075732 has no policy to be verified
2026-01-22 03:06:31,549 - DEBUG - Verifying the vn in opserver
2026-01-22 03:06:31,549 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732 virtual network link through opserver 10.0.0.38
2026-01-22 03:06:31,549 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:06:31,561 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732?flat'}
2026-01-22 03:06:31,561 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732 virtual network link through opserver 10.0.0.50
2026-01-22 03:06:31,561 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:06:31,575 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732?flat'}
2026-01-22 03:06:31,575 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732 virtual network link through opserver 10.0.0.131
2026-01-22 03:06:31,575 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:06:31,589 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732?flat'}
2026-01-22 03:06:31,589 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-56761044:ctest-left_vn-62075732 is found in opserver
2026-01-22 03:06:31,611 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 03:06:31,622 - DEBUG - VRF ids for VN ctest-left_vn-62075732: {}
2026-01-22 03:06:31,896 - DEBUG - Response for create_network : {'network': {'id': '0dac22bd-fbb5-4ac3-ae7e-41a86feb96a1', 'name': 'ctest-right_vn-84442579', 'tenant_id': 'ead446900b03438cbfabeaea20b0a186', 'project_id': 'ead446900b03438cbfabeaea20b0a186', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-56761044', 'ctest-right_vn-84442579'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:06:32,122 - DEBUG - Response for create_subnet : {'subnet': {'id': '5b0b064a-e5d7-45ca-a37b-55c82ce7ec0f', 'name': '', 'tenant_id': 'ead446900b03438cbfabeaea20b0a186', 'network_id': '0dac22bd-fbb5-4ac3-ae7e-41a86feb96a1', 'ip_version': 4, 'cidr': '19.21.15.128/26', 'allocation_pools': [{'start': '19.21.15.130', 'end': '19.21.15.190'}], 'gateway_ip': '19.21.15.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '19.21.15.130', 'tags': [], 'project_id': 'ead446900b03438cbfabeaea20b0a186'}}
2026-01-22 03:06:32,144 - INFO - Created VN ctest-right_vn-84442579
2026-01-22 03:06:32,156 - DEBUG - VN ctest-right_vn-84442579 UUID is 0dac22bd-fbb5-4ac3-ae7e-41a86feb96a1
2026-01-22 03:06:32,235 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:32,241 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:32,252 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:32,353 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0dac22bd-fbb5-4ac3-ae7e-41a86feb96a1
2026-01-22 03:06:32,366 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0dac22bd-fbb5-4ac3-ae7e-41a86feb96a1
2026-01-22 03:06:32,376 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/69e33f48-8d7f-4003-b50a-27d522657d98
2026-01-22 03:06:32,384 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/69e33f48-8d7f-4003-b50a-27d522657d98
2026-01-22 03:06:32,391 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/bdf42b35-9bd3-404b-b578-17d7918d745a
2026-01-22 03:06:32,398 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:06:32,398 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0dac22bd-fbb5-4ac3-ae7e-41a86feb96a1
2026-01-22 03:06:32,406 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/69e33f48-8d7f-4003-b50a-27d522657d98
2026-01-22 03:06:32,421 - INFO - Verified VN network id 14 for VN 0dac22bd-fbb5-4ac3-ae7e-41a86feb96a1
2026-01-22 03:06:32,421 - INFO - Verifications in API Server for VN ctest-right_vn-84442579 passed
2026-01-22 03:06:32,421 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0dac22bd-fbb5-4ac3-ae7e-41a86feb96a1
2026-01-22 03:06:32,432 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/69e33f48-8d7f-4003-b50a-27d522657d98
2026-01-22 03:06:32,439 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/69e33f48-8d7f-4003-b50a-27d522657d98
2026-01-22 03:06:32,446 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/bdf42b35-9bd3-404b-b578-17d7918d745a
2026-01-22 03:06:32,459 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '985200617854421699', 'uuid-lslong': '12573559401353025185'}, 'enable': 'true', 'created': '2026-01-22T03:06:31', 'last-modified': '2026-01-22T03:06:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399412'}
2026-01-22 03:06:32,464 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:06:32,470 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '985200617854421699', 'uuid-lslong': '12573559401353025185'}, 'enable': 'true', 'created': '2026-01-22T03:06:31', 'last-modified': '2026-01-22T03:06:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.415556'}
2026-01-22 03:06:32,477 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:06:32,482 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-56761044', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '985200617854421699', 'uuid-lslong': '12573559401353025185'}, 'enable': 'true', 'created': '2026-01-22T03:06:31', 'last-modified': '2026-01-22T03:06:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424310'}
2026-01-22 03:06:32,488 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:06:32,488 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-84442579 passed
2026-01-22 03:06:32,488 - DEBUG - ====Verifying policy data for ctest-right_vn-84442579 in API_Server ======
2026-01-22 03:06:32,488 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:32,495 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:32,508 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:32,601 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0dac22bd-fbb5-4ac3-ae7e-41a86feb96a1
2026-01-22 03:06:32,613 - DEBUG - =>VN ctest-right_vn-84442579 has no policy to be verified
2026-01-22 03:06:32,613 - DEBUG - Verifying the vn in opserver
2026-01-22 03:06:32,613 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579 virtual network link through opserver 10.0.0.38
2026-01-22 03:06:32,613 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:06:32,626 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579?flat'}
2026-01-22 03:06:32,627 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579 virtual network link through opserver 10.0.0.50
2026-01-22 03:06:32,627 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:06:32,640 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579?flat'}
2026-01-22 03:06:32,640 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579 virtual network link through opserver 10.0.0.131
2026-01-22 03:06:32,640 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:06:32,653 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579?flat'}
2026-01-22 03:06:32,653 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-56761044:ctest-right_vn-84442579 is found in opserver
2026-01-22 03:06:32,676 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 03:06:32,686 - DEBUG - VRF ids for VN ctest-right_vn-84442579: {}
2026-01-22 03:06:33,930 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-2)
2026-01-22 03:06:35,372 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-1)
2026-01-22 03:06:35,372 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-30160516']
2026-01-22 03:06:35,691 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-30160516'] created succesfully
2026-01-22 03:06:36,066 - DEBUG - Image by name tiny_nat_fw not found
2026-01-22 03:06:36,066 - DEBUG - Installing image tiny_nat_fw
2026-01-22 03:06:36,066 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2026-01-22 03:06:36,066 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2026-01-22 03:06:36,067 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2026-01-22 03:06:36,067 - DEBUG - Unzip image
2026-01-22 03:06:36,067 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2026-01-22 03:06:36,087 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2026-01-22 03:06:36,087 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-30160516']
2026-01-22 03:06:36,203 - INFO - Service template: ['default-domain', 'ctest-service_template_1-30160516'] deleted successfully.
2026-01-22 03:06:36,203 - INFO - Skip interface_detach for VM ctest-right_vm-36486413 in state BUILD
2026-01-22 03:06:36,203 - INFO - Deleting VM ctest-right_vm-36486413
2026-01-22 03:06:36,203 - ERROR - VM ctest-right_vm-36486413 has failed to come up
2026-01-22 03:06:36,203 - ERROR - Nova failed to get host of the VM
2026-01-22 03:06:36,203 - ERROR - VM ctest-right_vm-36486413 has failed to come up
2026-01-22 03:06:36,203 - ERROR - Nova failed to get host of the VM
2026-01-22 03:06:36,291 - INFO - Skip interface_detach for VM ctest-left_vm-69631980 in state BUILD
2026-01-22 03:06:36,291 - INFO - Deleting VM ctest-left_vm-69631980
2026-01-22 03:06:36,291 - ERROR - VM ctest-left_vm-69631980 has failed to come up
2026-01-22 03:06:36,291 - ERROR - Nova failed to get host of the VM
2026-01-22 03:06:36,292 - ERROR - VM ctest-left_vm-69631980 has failed to come up
2026-01-22 03:06:36,292 - ERROR - Nova failed to get host of the VM
2026-01-22 03:06:36,409 - INFO - Deleting VN ctest-right_vn-84442579
2026-01-22 03:06:36,475 - DEBUG - VN 0dac22bd-fbb5-4ac3-ae7e-41a86feb96a1 still in use: Unable to complete operation on network 0dac22bd-fbb5-4ac3-ae7e-41a86feb96a1. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-27abe3c5-c9c8-432a-88ec-8922ec045ecc']
2026-01-22 03:06:36,475 - WARNING - Deleting VN ctest-right_vn-84442579 failed..Will retry
2026-01-22 03:06:38,628 - DEBUG - Response for deleting network ()
2026-01-22 03:06:38,628 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/69e33f48-8d7f-4003-b50a-27d522657d98
2026-01-22 03:06:38,635 - DEBUG - Response Code: 404
2026-01-22 03:06:38,636 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:38,653 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:38,679 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:38,783 - INFO - Validated that VN ctest-right_vn-84442579 is not found in API Server
2026-01-22 03:06:38,798 - DEBUG - VN ctest-right_vn-84442579 is not present in Agent 10.0.0.23
2026-01-22 03:06:38,811 - DEBUG - VN ctest-right_vn-84442579 is not present in Agent 10.0.0.141
2026-01-22 03:06:38,811 - INFO - Validated that VN ctest-right_vn-84442579 is not in any agent
2026-01-22 03:06:38,851 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-84442579 info
2026-01-22 03:06:38,851 - INFO - Deleting VN ctest-left_vn-62075732
2026-01-22 03:06:39,021 - DEBUG - Response for deleting network ()
2026-01-22 03:06:39,021 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/31f7807d-4cbc-4d62-80af-1b85e8908b1a
2026-01-22 03:06:39,027 - DEBUG - Response Code: 404
2026-01-22 03:06:39,027 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:39,033 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:39,097 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:39,196 - INFO - Validated that VN ctest-left_vn-62075732 is not found in API Server
2026-01-22 03:06:39,208 - DEBUG - VN ctest-left_vn-62075732 is not present in Agent 10.0.0.23
2026-01-22 03:06:39,221 - DEBUG - VN ctest-left_vn-62075732 is not present in Agent 10.0.0.141
2026-01-22 03:06:39,221 - INFO - Validated that VN ctest-left_vn-62075732 is not in any agent
2026-01-22 03:06:39,254 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-62075732 info
2026-01-22 03:06:39,254 - INFO - Deleting VN ctest-mgmt_vn-70154836
2026-01-22 03:06:39,395 - DEBUG - Response for deleting network ()
2026-01-22 03:06:39,396 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9d4dc7c2-eed5-4c92-b616-08a81734b38a
2026-01-22 03:06:39,404 - DEBUG - Response Code: 404
2026-01-22 03:06:39,404 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:06:39,411 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:06:39,436 - DEBUG - Requesting: http://10.0.0.38:8082/project/ead44690-0b03-438c-bfab-eaea20b0a186
2026-01-22 03:06:39,536 - INFO - Validated that VN ctest-mgmt_vn-70154836 is not found in API Server
2026-01-22 03:06:39,549 - DEBUG - VN ctest-mgmt_vn-70154836 is not present in Agent 10.0.0.23
2026-01-22 03:06:39,561 - DEBUG - VN ctest-mgmt_vn-70154836 is not present in Agent 10.0.0.141
2026-01-22 03:06:39,561 - INFO - Validated that VN ctest-mgmt_vn-70154836 is not in any agent
2026-01-22 03:06:39,599 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-70154836 info
2026-01-22 03:06:40,885 - DEBUG - No XMPP flaps were noticed during the test
2026-01-22 03:06:40,885 - INFO -
2026-01-22 03:06:40,885 - INFO - END TEST : test_svc_in_network_datapath : SKIPPED[0:00:12]
2026-01-22 03:06:40,885 - INFO - --------------------------------------------------------------------------------
2026-01-22 03:06:41,650 - INFO - Deleted project: ctest-TestSvcRegr-56761044, ID : ead44690-0b03-438c-bfab-eaea20b0a186