2025-02-13 02:35:51,244 - INFO - Domain Default found not creating 2025-02-13 02:35:51,422 - INFO - Project ctest-TestBasicVMVN-91134780 not found, creating it 2025-02-13 02:35:51,918 - INFO - Created Project:ctest-TestBasicVMVN-91134780, ID : 9eb2637f-eb21-4a99-a630-afc68285636f 2025-02-13 02:35:53,351 - INFO - ================================================================================ 2025-02-13 02:35:53,351 - INFO - STARTING TEST : test_generic_link_local_service 2025-02-13 02:35:53,351 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-02-13 02:35:53,611 - DEBUG - Nothing to compare xmpp stats {'10.0.0.45': {'10.0.0.45': '0'}} with 2025-02-13 02:35:53,611 - INFO - Initial checks done. Running the testcase now 2025-02-13 02:35:53,611 - INFO - 2025-02-13 02:35:54,159 - DEBUG - Response for create_network : {'network': {'id': '8fb62366-140d-4bdf-b67a-ebdb7babc31a', 'name': 'ctest-vn2_metadata-40780349', 'tenant_id': '9eb2637feb214a99a630afc68285636f', 'project_id': '9eb2637feb214a99a630afc68285636f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-91134780', 'ctest-vn2_metadata-40780349'], 'port_security_enabled': True, 'description': ''}} 2025-02-13 02:35:54,385 - DEBUG - Response for create_subnet : {'subnet': {'id': '73bf7895-5666-437f-92c7-2a06a96ed154', 'name': '', 'tenant_id': '9eb2637feb214a99a630afc68285636f', 'network_id': '8fb62366-140d-4bdf-b67a-ebdb7babc31a', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '9eb2637feb214a99a630afc68285636f'}} 2025-02-13 02:35:54,402 - INFO - Created VN ctest-vn2_metadata-40780349 2025-02-13 02:35:54,456 - DEBUG - VN ctest-vn2_metadata-40780349 UUID is 8fb62366-140d-4bdf-b67a-ebdb7babc31a 2025-02-13 02:35:54,637 - DEBUG - Services list from nova: [, , ] 2025-02-13 02:35:55,683 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2729-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2729-1) 2025-02-13 02:35:55,788 - DEBUG - Link local service introspect added 2025-02-13 02:35:55,853 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-02-13 02:36:00,930 - DEBUG - VM is in ACTIVE state now 2025-02-13 02:36:01,056 - INFO - Waiting for VM ctest-TestBasicVMVN-91134780-67988321 to be up.. 2025-02-13 02:36:01,056 - INFO - VM name : ctest-TestBasicVMVN-91134780-67988321 2025-02-13 02:36:01,131 - DEBUG - VM ctest-TestBasicVMVN-91134780-67988321 ID is f76c22cb-d676-4dee-8a84-b1a92565236a 2025-02-13 02:36:01,131 - DEBUG - VM ctest-TestBasicVMVN-91134780-67988321 launched on Node cn-jenkins-deploy-platform-ansible-os-2729-1. 2025-02-13 02:36:01,216 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-machine/f76c22cb-d676-4dee-8a84-b1a92565236a 2025-02-13 02:36:01,514 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-machine/f76c22cb-d676-4dee-8a84-b1a92565236a 2025-02-13 02:36:01,552 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-machine-interface/d830c657-4a3f-4001-95be-61737bc35fc9 2025-02-13 02:36:04,811 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-02-13 02:36:04,811 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-91134780-67988321 failed! 2025-02-13 02:36:04,869 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-91134780:ctest-vn2_metadata-40780349 is 11.1.1.1 and allocation pool is NOT set 2025-02-13 02:36:06,930 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.17 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.910 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.910/4.039/7.169/3.129 ms') 2025-02-13 02:36:06,930 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-91134780-67988321 passed 2025-02-13 02:36:07,084 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-02-13 02:36:07,084 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-91134780-67988321, IP 11.1.1.3, Port 22 2025-02-13 02:36:07,244 - DEBUG - VM ctest-TestBasicVMVN-91134780-67988321 is ready for SSH connections 2025-02-13 02:36:07,244 - INFO - Retry 0 2025-02-13 02:36:07,244 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.45, gateway password: c0ntrail123 2025-02-13 02:36:07,244 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-02-13 02:36:08,825 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-02-13 02:36:08,825 - INFO - Generic metadata worked 2025-02-13 02:36:09,084 - DEBUG - Link local service introspect removed 2025-02-13 02:36:09,084 - INFO - Deleting VM ctest-TestBasicVMVN-91134780-67988321 2025-02-13 02:36:09,151 - INFO - Deleting VN ctest-vn2_metadata-40780349 2025-02-13 02:36:09,187 - DEBUG - VN 8fb62366-140d-4bdf-b67a-ebdb7babc31a still in use: Unable to complete operation on network 8fb62366-140d-4bdf-b67a-ebdb7babc31a. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f0a601df-8e7d-40f2-b8c1-6adf89dc84e5'] 2025-02-13 02:36:09,187 - WARNING - Deleting VN ctest-vn2_metadata-40780349 failed..Will retry 2025-02-13 02:36:11,326 - DEBUG - Response for deleting network () 2025-02-13 02:36:11,586 - DEBUG - No XMPP flaps were noticed during the test 2025-02-13 02:36:11,586 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:18] 2025-02-13 02:36:11,586 - INFO - -------------------------------------------------------------------------------- 2025-02-13 02:36:11,589 - INFO - ================================================================================ 2025-02-13 02:36:11,589 - INFO - STARTING TEST : test_metadata_service 2025-02-13 02:36:11,589 - INFO - TEST DESCRIPTION : Description: Test to validate metadata service on VM creation. 1.Verify from global-vrouter-config if metadata configures or not - fails otherwise 2.Create a shell script which writes 'hello world ' in a file in /tmp and save the script on the nova api node 3.Create a vm with userdata pointing to that script - script should get executed during vm boot up 4.Go to the vm and verify if the file with 'hello world ' written saved in /tmp of the vm - fails otherwise Maintainer: sandipd@juniper.net 2025-02-13 02:36:11,874 - DEBUG - Nothing to compare xmpp stats {'10.0.0.45': {'10.0.0.45': '0'}} with 2025-02-13 02:36:11,875 - INFO - Initial checks done. Running the testcase now 2025-02-13 02:36:11,875 - INFO - 2025-02-13 02:36:11,875 - DEBUG - Requesting: http://10.0.0.45:8082/global-vrouter-configs 2025-02-13 02:36:11,881 - DEBUG - Requesting: http://10.0.0.45:8082/global-vrouter-config/8b93f095-c257-45cc-8f14-b0810a0d99e2 2025-02-13 02:36:12,084 - DEBUG - Response for create_network : {'network': {'id': 'd53af2da-f7ea-401d-bdb8-2847fa8edcb6', 'name': 'ctest-vn-36852379', 'tenant_id': '9eb2637feb214a99a630afc68285636f', 'project_id': '9eb2637feb214a99a630afc68285636f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-91134780', 'ctest-vn-36852379'], 'port_security_enabled': True, 'description': ''}} 2025-02-13 02:36:12,262 - DEBUG - Response for create_subnet : {'subnet': {'id': '981d940f-096d-4bba-b1b7-f8855e7769d8', 'name': '', 'tenant_id': '9eb2637feb214a99a630afc68285636f', 'network_id': 'd53af2da-f7ea-401d-bdb8-2847fa8edcb6', 'ip_version': 4, 'cidr': '213.156.48.128/26', 'allocation_pools': [{'start': '213.156.48.130', 'end': '213.156.48.190'}], 'gateway_ip': '213.156.48.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '213.156.48.130', 'tags': [], 'project_id': '9eb2637feb214a99a630afc68285636f'}} 2025-02-13 02:36:12,279 - INFO - Created VN ctest-vn-36852379 2025-02-13 02:36:12,332 - DEBUG - VN ctest-vn-36852379 UUID is d53af2da-f7ea-401d-bdb8-2847fa8edcb6 2025-02-13 02:36:13,522 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2729-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2729-1) 2025-02-13 02:36:13,523 - INFO - Waiting for VM ctest-TestBasicVMVN-91134780-04829405 to be up.. 2025-02-13 02:36:13,568 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-02-13 02:36:18,647 - DEBUG - VM is in ACTIVE state now 2025-02-13 02:36:18,647 - INFO - VM name : ctest-TestBasicVMVN-91134780-04829405 2025-02-13 02:36:18,719 - DEBUG - VM ctest-TestBasicVMVN-91134780-04829405 ID is 9a98fc26-f1f9-498a-af11-6e86f5b6dd58 2025-02-13 02:36:18,719 - DEBUG - VM ctest-TestBasicVMVN-91134780-04829405 launched on Node cn-jenkins-deploy-platform-ansible-os-2729-1. 2025-02-13 02:36:18,801 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-machine/9a98fc26-f1f9-498a-af11-6e86f5b6dd58 2025-02-13 02:36:18,809 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-machine-interface/bd462458-c35f-411f-8ff7-601e839fd428 2025-02-13 02:36:22,030 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-02-13 02:36:22,030 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-91134780-04829405 failed! 2025-02-13 02:36:22,084 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-91134780:ctest-vn-36852379 is 213.156.48.129 and allocation pool is NOT set 2025-02-13 02:36:24,150 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.78 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.50 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.501/3.138/3.776/0.637 ms') 2025-02-13 02:36:24,151 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-91134780-04829405 passed 2025-02-13 02:36:24,301 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-02-13 02:36:24,301 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-91134780-04829405, IP 213.156.48.131, Port 22 2025-02-13 02:36:24,466 - DEBUG - VM ctest-TestBasicVMVN-91134780-04829405 is ready for SSH connections 2025-02-13 02:36:24,467 - DEBUG - Running remote_cmd, Cmd : cat /tmp/output.txt, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.45, gateway password: c0ntrail123 2025-02-13 02:36:24,467 - DEBUG - cat /tmp/output.txt 2025-02-13 02:36:26,083 - DEBUG - Hello World. The time is now Wed, 12 Feb 2025 19:36:24 -0700! 2025-02-13 02:36:26,083 - DEBUG - ret : {'cat /tmp/output.txt': 'Hello World. The time is now Wed, 12 Feb 2025 19:36:24 -0700!'} 2025-02-13 02:36:26,083 - INFO - metadata_script.txt got executed in the vm 2025-02-13 02:36:26,083 - INFO - Deleting VM ctest-TestBasicVMVN-91134780-04829405 2025-02-13 02:36:26,146 - INFO - Deleting VN ctest-vn-36852379 2025-02-13 02:36:26,184 - DEBUG - VN d53af2da-f7ea-401d-bdb8-2847fa8edcb6 still in use: Unable to complete operation on network d53af2da-f7ea-401d-bdb8-2847fa8edcb6. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-fe9761ff-f87d-42a2-afa3-7bc8a64bf90c'] 2025-02-13 02:36:26,184 - WARNING - Deleting VN ctest-vn-36852379 failed..Will retry 2025-02-13 02:36:28,285 - DEBUG - Response for deleting network () 2025-02-13 02:36:28,546 - DEBUG - No XMPP flaps were noticed during the test 2025-02-13 02:36:28,546 - INFO - END TEST : test_metadata_service : PASSED[0:00:17] 2025-02-13 02:36:28,546 - INFO - -------------------------------------------------------------------------------- 2025-02-13 02:36:28,549 - INFO - ================================================================================ 2025-02-13 02:36:28,549 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-02-13 02:36:28,549 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-02-13 02:36:28,833 - DEBUG - Nothing to compare xmpp stats {'10.0.0.45': {'10.0.0.45': '0'}} with 2025-02-13 02:36:28,833 - INFO - Initial checks done. Running the testcase now 2025-02-13 02:36:28,833 - INFO - 2025-02-13 02:36:29,338 - DEBUG - Response for create_network : {'network': {'id': '2b580e48-1a70-4b83-966c-684f9da5f370', 'name': 'ctest-vn-94146614', 'tenant_id': '9eb2637feb214a99a630afc68285636f', 'project_id': '9eb2637feb214a99a630afc68285636f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-91134780', 'ctest-vn-94146614'], 'port_security_enabled': True, 'description': ''}} 2025-02-13 02:36:29,534 - DEBUG - Response for create_subnet : {'subnet': {'id': '90ebc37c-2d08-4bab-adf3-580de143f91f', 'name': '', 'tenant_id': '9eb2637feb214a99a630afc68285636f', 'network_id': '2b580e48-1a70-4b83-966c-684f9da5f370', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': '9eb2637feb214a99a630afc68285636f'}} 2025-02-13 02:36:29,712 - DEBUG - Response for create_subnet : {'subnet': {'id': '101a24b2-a74b-43aa-9b94-357da60817a5', 'name': '', 'tenant_id': '9eb2637feb214a99a630afc68285636f', 'network_id': '2b580e48-1a70-4b83-966c-684f9da5f370', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': '9eb2637feb214a99a630afc68285636f'}} 2025-02-13 02:36:29,734 - INFO - Created VN ctest-vn-94146614 2025-02-13 02:36:29,788 - DEBUG - VN ctest-vn-94146614 UUID is 2b580e48-1a70-4b83-966c-684f9da5f370 2025-02-13 02:36:30,160 - DEBUG - Response for create_port : {'port': {'name': '96ca622d-36f6-4ea5-8635-b71f569e194b', 'id': '96ca622d-36f6-4ea5-8635-b71f569e194b', 'tenant_id': '9eb2637feb214a99a630afc68285636f', 'network_id': '2b580e48-1a70-4b83-966c-684f9da5f370', 'mac_address': '02:96:ca:62:2d:36', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '90ebc37c-2d08-4bab-adf3-580de143f91f'}], 'security_groups': ['5d6c606f-4b34-4e27-96d6-bd6740434ebe'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '9eb2637feb214a99a630afc68285636f'}} 2025-02-13 02:36:30,345 - DEBUG - Response for create_port : {'port': {'name': 'f994cf76-a629-41f7-b1c3-8f333fac0978', 'id': 'f994cf76-a629-41f7-b1c3-8f333fac0978', 'tenant_id': '9eb2637feb214a99a630afc68285636f', 'network_id': '2b580e48-1a70-4b83-966c-684f9da5f370', 'mac_address': '02:f9:94:cf:76:a6', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': '101a24b2-a74b-43aa-9b94-357da60817a5'}], 'security_groups': ['5d6c606f-4b34-4e27-96d6-bd6740434ebe'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '9eb2637feb214a99a630afc68285636f'}} 2025-02-13 02:36:30,769 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2729-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2729-1) 2025-02-13 02:36:31,197 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2729-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2729-1) 2025-02-13 02:36:32,412 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2729-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2729-1) 2025-02-13 02:36:32,412 - DEBUG - Requesting: http://10.0.0.45:8082/domains 2025-02-13 02:36:32,418 - DEBUG - Requesting: http://10.0.0.45:8082/domain/899d9b86-abcd-41ff-971c-2f46586d971a 2025-02-13 02:36:32,436 - DEBUG - Requesting: http://10.0.0.45:8082/project/9eb2637f-eb21-4a99-a630-afc68285636f 2025-02-13 02:36:32,518 - DEBUG - Requesting: http://10.0.0.45:8082/network-ipam/22f5a9e9-5a1c-477b-adc4-edf5e5c9ae79 2025-02-13 02:36:32,531 - INFO - Verifications in API Server for IPAM: ctest-ipam-53819436 passed 2025-02-13 02:36:32,539 - DEBUG - Control-node 10.0.0.45 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-91134780:ctest-ipam-53819436', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-91134780', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2519106386287937403', 'uuid-lslong': '12521394504374791801'}, 'enable': 'true', 'created': '2025-02-13T02:36:28', 'last-modified': '2025-02-13T02:36:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.475933'} 2025-02-13 02:36:32,539 - INFO - Verifications in Control node for IPAM: ctest-ipam-53819436 passed 2025-02-13 02:36:32,539 - DEBUG - Requesting: http://10.0.0.45:8082/domains 2025-02-13 02:36:32,548 - DEBUG - Requesting: http://10.0.0.45:8082/domain/899d9b86-abcd-41ff-971c-2f46586d971a 2025-02-13 02:36:32,566 - DEBUG - Requesting: http://10.0.0.45:8082/project/9eb2637f-eb21-4a99-a630-afc68285636f 2025-02-13 02:36:32,639 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-network/2b580e48-1a70-4b83-966c-684f9da5f370 2025-02-13 02:36:32,668 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-network/2b580e48-1a70-4b83-966c-684f9da5f370 2025-02-13 02:36:32,682 - DEBUG - Requesting: http://10.0.0.45:8082/routing-instance/343b8443-fc01-4e7c-bca8-1a292fe85bc6 2025-02-13 02:36:32,695 - DEBUG - Requesting: http://10.0.0.45:8082/routing-instance/343b8443-fc01-4e7c-bca8-1a292fe85bc6 2025-02-13 02:36:32,703 - DEBUG - Requesting: http://10.0.0.45:8082/route-target/c05d4de0-a991-42dd-af26-c20675ffea93 2025-02-13 02:36:32,712 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-02-13 02:36:32,712 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-network/2b580e48-1a70-4b83-966c-684f9da5f370 2025-02-13 02:36:32,724 - DEBUG - Requesting: http://10.0.0.45:8082/routing-instance/343b8443-fc01-4e7c-bca8-1a292fe85bc6 2025-02-13 02:36:32,744 - INFO - Verified VN network id 8 for VN 2b580e48-1a70-4b83-966c-684f9da5f370 2025-02-13 02:36:32,745 - INFO - Verifications in API Server for VN ctest-vn-94146614 passed 2025-02-13 02:36:32,745 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-network/2b580e48-1a70-4b83-966c-684f9da5f370 2025-02-13 02:36:32,760 - DEBUG - Requesting: http://10.0.0.45:8082/routing-instance/343b8443-fc01-4e7c-bca8-1a292fe85bc6 2025-02-13 02:36:32,770 - DEBUG - Requesting: http://10.0.0.45:8082/routing-instance/343b8443-fc01-4e7c-bca8-1a292fe85bc6 2025-02-13 02:36:32,778 - DEBUG - Requesting: http://10.0.0.45:8082/route-target/c05d4de0-a991-42dd-af26-c20675ffea93 2025-02-13 02:36:32,797 - DEBUG - Control-node 10.0.0.45 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-91134780:ctest-vn-94146614', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-91134780', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3123262044425440131', 'uuid-lslong': '10839153094330545008'}, 'enable': 'true', 'created': '2025-02-13T02:36:29', 'last-modified': '2025-02-13T02:36:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.124797'} 2025-02-13 02:36:32,811 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-02-13 02:36:32,811 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-94146614 passed 2025-02-13 02:36:32,811 - DEBUG - ====Verifying policy data for ctest-vn-94146614 in API_Server ====== 2025-02-13 02:36:32,812 - DEBUG - Requesting: http://10.0.0.45:8082/domains 2025-02-13 02:36:32,823 - DEBUG - Requesting: http://10.0.0.45:8082/domain/899d9b86-abcd-41ff-971c-2f46586d971a 2025-02-13 02:36:32,908 - DEBUG - Requesting: http://10.0.0.45:8082/project/9eb2637f-eb21-4a99-a630-afc68285636f 2025-02-13 02:36:33,038 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-network/2b580e48-1a70-4b83-966c-684f9da5f370 2025-02-13 02:36:33,063 - DEBUG - =>VN ctest-vn-94146614 has no policy to be verified 2025-02-13 02:36:33,063 - DEBUG - Verifying the vn in opserver 2025-02-13 02:36:33,063 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-91134780:ctest-vn-94146614 virtual network link through opserver 10.0.0.45 2025-02-13 02:36:33,063 - DEBUG - Requesting: http://10.0.0.45:8081/analytics/uves/virtual-networks 2025-02-13 02:36:33,397 - DEBUG - Requesting: http://10.0.0.45:8081/analytics/uves/virtual-networks 2025-02-13 02:36:33,456 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-91134780:ctest-vn-94146614', 'href': 'http://10.0.0.45:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-91134780:ctest-vn-94146614?flat'} 2025-02-13 02:36:33,457 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-91134780:ctest-vn-94146614 is found in opserver 2025-02-13 02:36:33,465 - DEBUG - VRF ids for VN ctest-vn-94146614: {'10.0.0.45': '2'} 2025-02-13 02:36:33,465 - INFO - Waiting for VM ctest-TestBasicVMVN-91134780-13763254 to be up.. 2025-02-13 02:36:33,582 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-02-13 02:36:38,668 - DEBUG - VM is in ACTIVE state now 2025-02-13 02:36:38,668 - INFO - VM name : ctest-TestBasicVMVN-91134780-13763254 2025-02-13 02:36:38,764 - DEBUG - VM ctest-TestBasicVMVN-91134780-13763254 ID is 93bc16a1-f1eb-40be-8c3d-928f65dce869 2025-02-13 02:36:38,764 - DEBUG - VM ctest-TestBasicVMVN-91134780-13763254 launched on Node cn-jenkins-deploy-platform-ansible-os-2729-1. 2025-02-13 02:36:38,854 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-machine/93bc16a1-f1eb-40be-8c3d-928f65dce869 2025-02-13 02:36:38,865 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-machine-interface/96ca622d-36f6-4ea5-8635-b71f569e194b 2025-02-13 02:36:42,121 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-02-13 02:36:42,121 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-91134780-13763254 failed! 2025-02-13 02:36:42,176 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-91134780:ctest-vn-94146614 is 31.1.1.1 and allocation pool is NOT set 2025-02-13 02:36:42,176 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-91134780:ctest-vn-94146614 is 31.1.2.1 and allocation pool is NOT set 2025-02-13 02:36:44,232 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.22 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.444 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.444/1.830/3.216/1.386 ms') 2025-02-13 02:36:44,232 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-91134780-13763254 passed 2025-02-13 02:36:44,393 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-02-13 02:36:44,393 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-91134780-13763254, IP 31.1.1.4, Port 22 2025-02-13 02:36:44,552 - DEBUG - VM ctest-TestBasicVMVN-91134780-13763254 is ready for SSH connections 2025-02-13 02:36:44,552 - INFO - Waiting for VM ctest-TestBasicVMVN-91134780-00206330 to be up.. 2025-02-13 02:36:44,633 - DEBUG - VM is in ACTIVE state now 2025-02-13 02:36:44,633 - INFO - VM name : ctest-TestBasicVMVN-91134780-00206330 2025-02-13 02:36:44,709 - DEBUG - VM ctest-TestBasicVMVN-91134780-00206330 ID is f02f7e87-c018-4972-9b6a-fe84cd1d3019 2025-02-13 02:36:44,709 - DEBUG - VM ctest-TestBasicVMVN-91134780-00206330 launched on Node cn-jenkins-deploy-platform-ansible-os-2729-1. 2025-02-13 02:36:44,786 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-machine/f02f7e87-c018-4972-9b6a-fe84cd1d3019 2025-02-13 02:36:44,798 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-machine-interface/f994cf76-a629-41f7-b1c3-8f333fac0978 2025-02-13 02:36:46,052 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.65 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.460 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.460/1.555/2.650/1.095 ms') 2025-02-13 02:36:46,052 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-91134780-00206330 passed 2025-02-13 02:36:46,204 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-02-13 02:36:46,205 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-91134780-00206330, IP 31.1.2.4, Port 22 2025-02-13 02:36:46,360 - DEBUG - VM ctest-TestBasicVMVN-91134780-00206330 is ready for SSH connections 2025-02-13 02:36:46,360 - INFO - Waiting for VM ctest-TestBasicVMVN-91134780-30764276 to be up.. 2025-02-13 02:36:46,440 - DEBUG - VM is in ACTIVE state now 2025-02-13 02:36:46,441 - INFO - VM name : ctest-TestBasicVMVN-91134780-30764276 2025-02-13 02:36:46,513 - DEBUG - VM ctest-TestBasicVMVN-91134780-30764276 ID is 25538864-972d-4f7d-a8ed-b634d021f663 2025-02-13 02:36:46,513 - DEBUG - VM ctest-TestBasicVMVN-91134780-30764276 launched on Node cn-jenkins-deploy-platform-ansible-os-2729-1. 2025-02-13 02:36:46,585 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-machine/25538864-972d-4f7d-a8ed-b634d021f663 2025-02-13 02:36:46,594 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-machine-interface/e845bc27-d39b-4075-adfd-ea2a27e24eab 2025-02-13 02:36:47,837 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=2.80 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.384 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.384/1.591/2.799/1.207 ms') 2025-02-13 02:36:47,837 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-91134780-30764276 passed 2025-02-13 02:36:47,992 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-02-13 02:36:47,992 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-91134780-30764276, IP 31.1.1.3, Port 22 2025-02-13 02:36:48,148 - DEBUG - VM ctest-TestBasicVMVN-91134780-30764276 is ready for SSH connections 2025-02-13 02:36:48,148 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-02-13 02:36:48,148 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.45, gateway password: c0ntrail123 2025-02-13 02:36:48,148 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2025-02-13 02:36:52,093 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.865 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.475 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=0.881 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.881/2.073/3.865 ms 2025-02-13 02:36:52,094 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-91134780-13763254 passed 2025-02-13 02:36:52,094 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-02-13 02:36:52,094 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.45, gateway password: c0ntrail123 2025-02-13 02:36:52,094 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2025-02-13 02:36:55,774 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=2.764 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=1.189 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=1.307 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.189/1.753/2.764 ms 2025-02-13 02:36:55,774 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-91134780-00206330 passed 2025-02-13 02:36:55,774 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-02-13 02:36:55,774 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-02-13 02:36:55,775 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-02-13 02:36:55,775 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.45, gateway password: c0ntrail123 2025-02-13 02:36:55,775 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-02-13 02:36:55,951 - DEBUG - None 2025-02-13 02:36:55,951 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.45, gateway password: c0ntrail123 2025-02-13 02:36:55,951 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-02-13 02:36:56,127 - DEBUG - None 2025-02-13 02:36:56,128 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.45, gateway password: c0ntrail123 2025-02-13 02:36:56,128 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-02-13 02:36:56,736 - DEBUG - None 2025-02-13 02:36:56,737 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.45, gateway password: c0ntrail123 2025-02-13 02:36:56,737 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2025-02-13 02:36:58,941 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.394 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=6.061 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.401 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.554 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.356 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.356/2.153/6.061 ms 2025-02-13 02:36:58,941 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.45, gateway password: c0ntrail123 2025-02-13 02:36:58,941 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2025-02-13 02:37:01,177 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.009 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.980 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.963 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.591 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.146 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=3.144 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.365 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.365/2.314/4.963 ms 2025-02-13 02:37:01,177 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.45, gateway password: c0ntrail123 2025-02-13 02:37:01,177 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2025-02-13 02:37:03,417 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.031 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=2.901 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.640 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.434 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.279 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=3.435 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.523 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.434/2.034/3.640 ms 2025-02-13 02:37:03,417 - INFO - Deleting VM ctest-TestBasicVMVN-91134780-30764276 2025-02-13 02:37:03,485 - INFO - Detaching port f994cf76-a629-41f7-b1c3-8f333fac0978 from VM ctest-TestBasicVMVN-91134780-00206330 2025-02-13 02:37:03,531 - INFO - Deleting VM ctest-TestBasicVMVN-91134780-00206330 2025-02-13 02:37:03,600 - INFO - Detaching port 96ca622d-36f6-4ea5-8635-b71f569e194b from VM ctest-TestBasicVMVN-91134780-13763254 2025-02-13 02:37:03,634 - INFO - Deleting VM ctest-TestBasicVMVN-91134780-13763254 2025-02-13 02:37:03,704 - INFO - Deleting VN ctest-vn-94146614 2025-02-13 02:37:03,866 - DEBUG - Response for delete_port : () 2025-02-13 02:37:04,002 - DEBUG - Response for delete_port : () 2025-02-13 02:37:04,052 - DEBUG - VN 2b580e48-1a70-4b83-966c-684f9da5f370 still in use: Unable to complete operation on network 2b580e48-1a70-4b83-966c-684f9da5f370. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-5287747a-04e8-4ddd-bff2-301c5d5b1f6a'] 2025-02-13 02:37:04,053 - WARNING - Deleting VN ctest-vn-94146614 failed..Will retry 2025-02-13 02:37:06,187 - DEBUG - Response for deleting network () 2025-02-13 02:37:06,187 - DEBUG - Requesting: http://10.0.0.45:8082/routing-instance/343b8443-fc01-4e7c-bca8-1a292fe85bc6 2025-02-13 02:37:06,196 - DEBUG - Response Code: 404 2025-02-13 02:37:06,197 - DEBUG - Requesting: http://10.0.0.45:8082/domains 2025-02-13 02:37:06,203 - DEBUG - Requesting: http://10.0.0.45:8082/domain/899d9b86-abcd-41ff-971c-2f46586d971a 2025-02-13 02:37:06,260 - DEBUG - Requesting: http://10.0.0.45:8082/project/9eb2637f-eb21-4a99-a630-afc68285636f 2025-02-13 02:37:06,340 - INFO - Validated that VN ctest-vn-94146614 is not found in API Server 2025-02-13 02:37:06,353 - DEBUG - VN ctest-vn-94146614 is not present in Agent 10.0.0.45 2025-02-13 02:37:06,353 - INFO - Validated that VN ctest-vn-94146614 is not in any agent 2025-02-13 02:37:06,359 - DEBUG - VRF 2 is not seen in agent 10.0.0.45 2025-02-13 02:37:06,364 - DEBUG - Vrouter 10.0.0.45 does not have vrf 2 for VN ctest-vn-94146614 2025-02-13 02:37:06,364 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-91134780:ctest-vn-94146614 2025-02-13 02:37:06,375 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-94146614 info 2025-02-13 02:37:06,452 - INFO - IPAM: ctest-ipam-53819436 is not found in API Server 2025-02-13 02:37:06,466 - INFO - IPAM:ctest-ipam-53819436 is not found in control node 2025-02-13 02:37:06,724 - DEBUG - No XMPP flaps were noticed during the test 2025-02-13 02:37:06,724 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:38] 2025-02-13 02:37:06,724 - INFO - -------------------------------------------------------------------------------- 2025-02-13 02:37:07,474 - INFO - Deleted project: ctest-TestBasicVMVN-91134780, ID : 9eb2637f-eb21-4a99-a630-afc68285636f