2025-03-22 02:37:58,813 - INFO - Domain Default found not creating 2025-03-22 02:37:58,994 - INFO - Project ctest-TestBasicVMVN-54422518 not found, creating it 2025-03-22 02:37:59,512 - INFO - Created Project:ctest-TestBasicVMVN-54422518, ID : 65434176-2e03-4f85-8e75-ac49bed39760 2025-03-22 02:38:01,144 - INFO - ================================================================================ 2025-03-22 02:38:01,145 - INFO - STARTING TEST : test_generic_link_local_service 2025-03-22 02:38:01,145 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-03-22 02:38:01,399 - DEBUG - Nothing to compare xmpp stats {'10.0.0.28': {'10.20.0.13': '0'}} with 2025-03-22 02:38:01,400 - INFO - Initial checks done. Running the testcase now 2025-03-22 02:38:01,400 - INFO - 2025-03-22 02:38:01,966 - DEBUG - Response for create_network : {'network': {'id': '6dd8a43d-8b1e-4081-b5d1-6d4bad1ee672', 'name': 'ctest-vn2_metadata-53911272', 'tenant_id': '654341762e034f858e75ac49bed39760', 'project_id': '654341762e034f858e75ac49bed39760', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-54422518', 'ctest-vn2_metadata-53911272'], 'port_security_enabled': True, 'description': ''}} 2025-03-22 02:38:02,167 - DEBUG - Response for create_subnet : {'subnet': {'id': '9499ec67-fb53-42fc-bf42-82e5669b0b3c', 'name': '', 'tenant_id': '654341762e034f858e75ac49bed39760', 'network_id': '6dd8a43d-8b1e-4081-b5d1-6d4bad1ee672', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '654341762e034f858e75ac49bed39760'}} 2025-03-22 02:38:02,187 - INFO - Created VN ctest-vn2_metadata-53911272 2025-03-22 02:38:02,241 - DEBUG - VN ctest-vn2_metadata-53911272 UUID is 6dd8a43d-8b1e-4081-b5d1-6d4bad1ee672 2025-03-22 02:38:02,435 - DEBUG - Services list from nova: [, , ] 2025-03-22 02:38:03,604 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2933-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2933-1) 2025-03-22 02:38:03,717 - DEBUG - Link local service introspect added 2025-03-22 02:38:03,760 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-03-22 02:38:08,854 - DEBUG - VM is in ACTIVE state now 2025-03-22 02:38:08,984 - INFO - Waiting for VM ctest-TestBasicVMVN-54422518-28920752 to be up.. 2025-03-22 02:38:08,984 - INFO - VM name : ctest-TestBasicVMVN-54422518-28920752 2025-03-22 02:38:09,073 - DEBUG - VM ctest-TestBasicVMVN-54422518-28920752 ID is 16386fcc-e265-4042-9f3a-fb6e3de72c30 2025-03-22 02:38:09,073 - DEBUG - VM ctest-TestBasicVMVN-54422518-28920752 launched on Node cn-jenkins-deploy-platform-ansible-os-2933-1 2025-03-22 02:38:09,152 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/16386fcc-e265-4042-9f3a-fb6e3de72c30 2025-03-22 02:38:09,447 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/16386fcc-e265-4042-9f3a-fb6e3de72c30 2025-03-22 02:38:09,483 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/b3f7602c-f7fd-44e5-ba60-3aba36f8971b 2025-03-22 02:38:12,738 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-03-22 02:38:12,738 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-54422518-28920752 failed! 2025-03-22 02:38:12,797 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-54422518:ctest-vn2_metadata-53911272 is 11.1.1.1 and allocation pool is NOT set 2025-03-22 02:38:14,860 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.33 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.34 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.336/5.834/8.332/2.498 ms') 2025-03-22 02:38:14,860 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-54422518-28920752 passed 2025-03-22 02:38:15,009 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:38:15,009 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-54422518-28920752, IP 11.1.1.3, Port 22 2025-03-22 02:38:15,075 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-03-22 02:38:15,178 - DEBUG - VM ctest-TestBasicVMVN-54422518-28920752 is NOT ready for SSH connections, VM status: ACTIVE 2025-03-22 02:38:20,179 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:38:20,179 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-54422518-28920752, IP 11.1.1.3, Port 22 2025-03-22 02:38:20,336 - DEBUG - VM ctest-TestBasicVMVN-54422518-28920752 is ready for SSH connections 2025-03-22 02:38:20,336 - INFO - Retry 0 2025-03-22 02:38:20,337 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.28, gateway password: c0ntrail123 2025-03-22 02:38:20,337 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-03-22 02:38:22,004 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-03-22 02:38:22,004 - INFO - Generic metadata worked 2025-03-22 02:38:22,277 - DEBUG - Link local service introspect removed 2025-03-22 02:38:22,277 - INFO - Deleting VM ctest-TestBasicVMVN-54422518-28920752 2025-03-22 02:38:22,356 - INFO - Deleting VN ctest-vn2_metadata-53911272 2025-03-22 02:38:22,399 - DEBUG - VN 6dd8a43d-8b1e-4081-b5d1-6d4bad1ee672 still in use: Unable to complete operation on network 6dd8a43d-8b1e-4081-b5d1-6d4bad1ee672. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-dc0258e6-6db5-438e-a6bf-98d9496e3632'] 2025-03-22 02:38:22,399 - WARNING - Deleting VN ctest-vn2_metadata-53911272 failed..Will retry 2025-03-22 02:38:24,516 - DEBUG - Response for deleting network () 2025-03-22 02:38:24,774 - DEBUG - No XMPP flaps were noticed during the test 2025-03-22 02:38:24,774 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:23] 2025-03-22 02:38:24,775 - INFO - -------------------------------------------------------------------------------- 2025-03-22 02:38:24,777 - INFO - ================================================================================ 2025-03-22 02:38:24,777 - INFO - STARTING TEST : test_metadata_service 2025-03-22 02:38:24,777 - INFO - TEST DESCRIPTION : Description: Test to validate metadata service on VM creation. 1.Verify from global-vrouter-config if metadata configures or not - fails otherwise 2.Create a shell script which writes 'hello world ' in a file in /tmp and save the script on the nova api node 3.Create a vm with userdata pointing to that script - script should get executed during vm boot up 4.Go to the vm and verify if the file with 'hello world ' written saved in /tmp of the vm - fails otherwise Maintainer: sandipd@juniper.net 2025-03-22 02:38:25,076 - DEBUG - Nothing to compare xmpp stats {'10.0.0.28': {'10.20.0.13': '0'}} with 2025-03-22 02:38:25,076 - INFO - Initial checks done. Running the testcase now 2025-03-22 02:38:25,076 - INFO - 2025-03-22 02:38:25,077 - DEBUG - Requesting: http://10.0.0.28:8082/global-vrouter-configs 2025-03-22 02:38:25,084 - DEBUG - Requesting: http://10.0.0.28:8082/global-vrouter-config/cd44daf2-d504-4863-8b75-2004509d5df6 2025-03-22 02:38:25,297 - DEBUG - Response for create_network : {'network': {'id': 'a35df374-1a3e-492b-82ad-c616c951831d', 'name': 'ctest-vn-91617905', 'tenant_id': '654341762e034f858e75ac49bed39760', 'project_id': '654341762e034f858e75ac49bed39760', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-54422518', 'ctest-vn-91617905'], 'port_security_enabled': True, 'description': ''}} 2025-03-22 02:38:25,477 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f7db7562-213e-44ce-b4a3-7d4b3d556a77', 'name': '', 'tenant_id': '654341762e034f858e75ac49bed39760', 'network_id': 'a35df374-1a3e-492b-82ad-c616c951831d', 'ip_version': 4, 'cidr': '178.68.241.192/26', 'allocation_pools': [{'start': '178.68.241.194', 'end': '178.68.241.254'}], 'gateway_ip': '178.68.241.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '178.68.241.194', 'tags': [], 'project_id': '654341762e034f858e75ac49bed39760'}} 2025-03-22 02:38:25,496 - INFO - Created VN ctest-vn-91617905 2025-03-22 02:38:25,549 - DEBUG - VN ctest-vn-91617905 UUID is a35df374-1a3e-492b-82ad-c616c951831d 2025-03-22 02:38:26,751 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2933-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2933-1) 2025-03-22 02:38:26,751 - INFO - Waiting for VM ctest-TestBasicVMVN-54422518-87214572 to be up.. 2025-03-22 02:38:26,800 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-03-22 02:38:31,890 - DEBUG - VM is in ACTIVE state now 2025-03-22 02:38:31,890 - INFO - VM name : ctest-TestBasicVMVN-54422518-87214572 2025-03-22 02:38:31,976 - DEBUG - VM ctest-TestBasicVMVN-54422518-87214572 ID is a2697206-6c7c-4df0-b497-fc726a7680f9 2025-03-22 02:38:31,976 - DEBUG - VM ctest-TestBasicVMVN-54422518-87214572 launched on Node cn-jenkins-deploy-platform-ansible-os-2933-1 2025-03-22 02:38:32,063 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/a2697206-6c7c-4df0-b497-fc726a7680f9 2025-03-22 02:38:32,073 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/67c4e56b-5aa4-4412-91c6-67ac157aeddf 2025-03-22 02:38:35,335 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-03-22 02:38:35,335 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-54422518-87214572 failed! 2025-03-22 02:38:35,393 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-54422518:ctest-vn-91617905 is 178.68.241.193 and allocation pool is NOT set 2025-03-22 02:38:37,452 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=11.2 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.937 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.937/6.063/11.189/5.126 ms') 2025-03-22 02:38:37,452 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-54422518-87214572 passed 2025-03-22 02:38:37,613 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:38:37,613 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-54422518-87214572, IP 178.68.241.195, Port 22 2025-03-22 02:38:37,669 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-03-22 02:38:37,753 - DEBUG - VM ctest-TestBasicVMVN-54422518-87214572 is NOT ready for SSH connections, VM status: ACTIVE 2025-03-22 02:38:42,754 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:38:42,754 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-54422518-87214572, IP 178.68.241.195, Port 22 2025-03-22 02:38:42,913 - DEBUG - VM ctest-TestBasicVMVN-54422518-87214572 is ready for SSH connections 2025-03-22 02:38:42,913 - DEBUG - Running remote_cmd, Cmd : cat /tmp/output.txt, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.28, gateway password: c0ntrail123 2025-03-22 02:38:42,913 - DEBUG - cat /tmp/output.txt 2025-03-22 02:38:44,559 - DEBUG - Hello World. The time is now Fri, 21 Mar 2025 20:38:38 -0600! 2025-03-22 02:38:44,559 - DEBUG - ret : {'cat /tmp/output.txt': 'Hello World. The time is now Fri, 21 Mar 2025 20:38:38 -0600!'} 2025-03-22 02:38:44,559 - INFO - metadata_script.txt got executed in the vm 2025-03-22 02:38:44,559 - INFO - Deleting VM ctest-TestBasicVMVN-54422518-87214572 2025-03-22 02:38:44,650 - INFO - Deleting VN ctest-vn-91617905 2025-03-22 02:38:44,697 - DEBUG - VN a35df374-1a3e-492b-82ad-c616c951831d still in use: Unable to complete operation on network a35df374-1a3e-492b-82ad-c616c951831d. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-df59edc0-26bc-44a9-b733-d04f91daaec4'] 2025-03-22 02:38:44,697 - WARNING - Deleting VN ctest-vn-91617905 failed..Will retry 2025-03-22 02:38:46,826 - DEBUG - Response for deleting network () 2025-03-22 02:38:47,091 - DEBUG - No XMPP flaps were noticed during the test 2025-03-22 02:38:47,091 - INFO - END TEST : test_metadata_service : PASSED[0:00:23] 2025-03-22 02:38:47,091 - INFO - -------------------------------------------------------------------------------- 2025-03-22 02:38:47,094 - INFO - ================================================================================ 2025-03-22 02:38:47,094 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-03-22 02:38:47,094 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-03-22 02:38:47,380 - DEBUG - Nothing to compare xmpp stats {'10.0.0.28': {'10.20.0.13': '0'}} with 2025-03-22 02:38:47,380 - INFO - Initial checks done. Running the testcase now 2025-03-22 02:38:47,380 - INFO - 2025-03-22 02:38:47,878 - DEBUG - Response for create_network : {'network': {'id': '03fe90de-3aba-46b7-9f02-ad314bd0d4d5', 'name': 'ctest-vn-69584044', 'tenant_id': '654341762e034f858e75ac49bed39760', 'project_id': '654341762e034f858e75ac49bed39760', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-54422518', 'ctest-vn-69584044'], 'port_security_enabled': True, 'description': ''}} 2025-03-22 02:38:48,077 - DEBUG - Response for create_subnet : {'subnet': {'id': '467d4040-c03d-4bb8-b7d9-1f7ea3403ddf', 'name': '', 'tenant_id': '654341762e034f858e75ac49bed39760', 'network_id': '03fe90de-3aba-46b7-9f02-ad314bd0d4d5', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': '654341762e034f858e75ac49bed39760'}} 2025-03-22 02:38:48,269 - DEBUG - Response for create_subnet : {'subnet': {'id': '24a82754-23aa-41d0-9e8e-b3eaf12d99f4', 'name': '', 'tenant_id': '654341762e034f858e75ac49bed39760', 'network_id': '03fe90de-3aba-46b7-9f02-ad314bd0d4d5', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': '654341762e034f858e75ac49bed39760'}} 2025-03-22 02:38:48,291 - INFO - Created VN ctest-vn-69584044 2025-03-22 02:38:48,345 - DEBUG - VN ctest-vn-69584044 UUID is 03fe90de-3aba-46b7-9f02-ad314bd0d4d5 2025-03-22 02:38:48,750 - DEBUG - Response for create_port : {'port': {'name': 'a1400a67-5e23-425d-9bfa-764454a55349', 'id': 'a1400a67-5e23-425d-9bfa-764454a55349', 'tenant_id': '654341762e034f858e75ac49bed39760', 'network_id': '03fe90de-3aba-46b7-9f02-ad314bd0d4d5', 'mac_address': '02:a1:40:0a:67:5e', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '467d4040-c03d-4bb8-b7d9-1f7ea3403ddf'}], 'security_groups': ['f2574c87-c95a-4b03-87fd-d6f557da8a85'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '654341762e034f858e75ac49bed39760'}} 2025-03-22 02:38:48,955 - DEBUG - Response for create_port : {'port': {'name': '20a12068-a732-4df4-9aec-2ca8219972ce', 'id': '20a12068-a732-4df4-9aec-2ca8219972ce', 'tenant_id': '654341762e034f858e75ac49bed39760', 'network_id': '03fe90de-3aba-46b7-9f02-ad314bd0d4d5', 'mac_address': '02:20:a1:20:68:a7', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': '24a82754-23aa-41d0-9e8e-b3eaf12d99f4'}], 'security_groups': ['f2574c87-c95a-4b03-87fd-d6f557da8a85'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '654341762e034f858e75ac49bed39760'}} 2025-03-22 02:38:49,377 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2933-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2933-1) 2025-03-22 02:38:49,814 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2933-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2933-1) 2025-03-22 02:38:51,122 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2933-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2933-1) 2025-03-22 02:38:51,122 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2025-03-22 02:38:51,134 - DEBUG - Requesting: http://10.0.0.28:8082/domain/7515f5f3-a6e3-4058-9d58-c95eec6d9d9a 2025-03-22 02:38:51,150 - DEBUG - Requesting: http://10.0.0.28:8082/project/65434176-2e03-4f85-8e75-ac49bed39760 2025-03-22 02:38:51,231 - DEBUG - Requesting: http://10.0.0.28:8082/network-ipam/d96be046-aef4-480b-b853-6d308e17c739 2025-03-22 02:38:51,246 - INFO - Verifications in API Server for IPAM: ctest-ipam-68742831 passed 2025-03-22 02:38:51,253 - DEBUG - Control-node 10.0.0.28 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-54422518:ctest-ipam-68742831', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-54422518', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15666862322925979659', 'uuid-lslong': '13282079781355505465'}, 'enable': 'true', 'created': '2025-03-22T02:38:47', 'last-modified': '2025-03-22T02:38:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.642007'} 2025-03-22 02:38:51,253 - INFO - Verifications in Control node for IPAM: ctest-ipam-68742831 passed 2025-03-22 02:38:51,253 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2025-03-22 02:38:51,266 - DEBUG - Requesting: http://10.0.0.28:8082/domain/7515f5f3-a6e3-4058-9d58-c95eec6d9d9a 2025-03-22 02:38:51,285 - DEBUG - Requesting: http://10.0.0.28:8082/project/65434176-2e03-4f85-8e75-ac49bed39760 2025-03-22 02:38:51,370 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/03fe90de-3aba-46b7-9f02-ad314bd0d4d5 2025-03-22 02:38:51,391 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/03fe90de-3aba-46b7-9f02-ad314bd0d4d5 2025-03-22 02:38:51,409 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/0cb34ce1-e9df-4f8a-8102-6303225e8c0a 2025-03-22 02:38:51,421 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/0cb34ce1-e9df-4f8a-8102-6303225e8c0a 2025-03-22 02:38:51,433 - DEBUG - Requesting: http://10.0.0.28:8082/route-target/d3bb848f-b23b-4e48-a1a0-f33c05d13c40 2025-03-22 02:38:51,444 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-03-22 02:38:51,444 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/03fe90de-3aba-46b7-9f02-ad314bd0d4d5 2025-03-22 02:38:51,464 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/0cb34ce1-e9df-4f8a-8102-6303225e8c0a 2025-03-22 02:38:51,484 - INFO - Verified VN network id 8 for VN 03fe90de-3aba-46b7-9f02-ad314bd0d4d5 2025-03-22 02:38:51,484 - INFO - Verifications in API Server for VN ctest-vn-69584044 passed 2025-03-22 02:38:51,485 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/03fe90de-3aba-46b7-9f02-ad314bd0d4d5 2025-03-22 02:38:51,498 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/0cb34ce1-e9df-4f8a-8102-6303225e8c0a 2025-03-22 02:38:51,509 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/0cb34ce1-e9df-4f8a-8102-6303225e8c0a 2025-03-22 02:38:51,519 - DEBUG - Requesting: http://10.0.0.28:8082/route-target/d3bb848f-b23b-4e48-a1a0-f33c05d13c40 2025-03-22 02:38:51,535 - DEBUG - Control-node 10.0.0.28 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-54422518:ctest-vn-69584044', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-54422518', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '287826710340716215', 'uuid-lslong': '11457910829220943061'}, 'enable': 'true', 'created': '2025-03-22T02:38:47', 'last-modified': '2025-03-22T02:38:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.299246'} 2025-03-22 02:38:51,548 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-03-22 02:38:51,548 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-69584044 passed 2025-03-22 02:38:51,548 - DEBUG - ====Verifying policy data for ctest-vn-69584044 in API_Server ====== 2025-03-22 02:38:51,549 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2025-03-22 02:38:51,564 - DEBUG - Requesting: http://10.0.0.28:8082/domain/7515f5f3-a6e3-4058-9d58-c95eec6d9d9a 2025-03-22 02:38:51,583 - DEBUG - Requesting: http://10.0.0.28:8082/project/65434176-2e03-4f85-8e75-ac49bed39760 2025-03-22 02:38:51,634 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/03fe90de-3aba-46b7-9f02-ad314bd0d4d5 2025-03-22 02:38:51,654 - DEBUG - =>VN ctest-vn-69584044 has no policy to be verified 2025-03-22 02:38:51,654 - DEBUG - Verifying the vn in opserver 2025-03-22 02:38:51,654 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-54422518:ctest-vn-69584044 virtual network link through opserver 10.0.0.28 2025-03-22 02:38:51,654 - DEBUG - Requesting: http://10.0.0.28:8081/analytics/uves/virtual-networks 2025-03-22 02:38:52,030 - DEBUG - Requesting: http://10.0.0.28:8081/analytics/uves/virtual-networks 2025-03-22 02:38:52,119 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-54422518:ctest-vn-69584044', 'href': 'http://10.0.0.28:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-54422518:ctest-vn-69584044?flat'} 2025-03-22 02:38:52,119 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-54422518:ctest-vn-69584044 is found in opserver 2025-03-22 02:38:52,129 - DEBUG - VRF ids for VN ctest-vn-69584044: {'10.0.0.28': '2'} 2025-03-22 02:38:52,129 - INFO - Waiting for VM ctest-TestBasicVMVN-54422518-13384058 to be up.. 2025-03-22 02:38:52,251 - DEBUG - VM is in ACTIVE state now 2025-03-22 02:38:52,251 - INFO - VM name : ctest-TestBasicVMVN-54422518-13384058 2025-03-22 02:38:52,359 - DEBUG - VM ctest-TestBasicVMVN-54422518-13384058 ID is ace16195-ef63-46cb-9fe8-6b07af1b022e 2025-03-22 02:38:52,359 - DEBUG - VM ctest-TestBasicVMVN-54422518-13384058 launched on Node cn-jenkins-deploy-platform-ansible-os-2933-1 2025-03-22 02:38:52,475 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/ace16195-ef63-46cb-9fe8-6b07af1b022e 2025-03-22 02:38:52,488 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/a1400a67-5e23-425d-9bfa-764454a55349 2025-03-22 02:38:55,781 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-03-22 02:38:55,782 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-54422518-13384058 failed! 2025-03-22 02:38:55,841 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-54422518:ctest-vn-69584044 is 31.1.1.1 and allocation pool is NOT set 2025-03-22 02:38:55,841 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-54422518:ctest-vn-69584044 is 31.1.2.1 and allocation pool is NOT set 2025-03-22 02:38:59,916 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-03-22 02:38:59,916 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-54422518-13384058 failed! 2025-03-22 02:38:59,977 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-54422518:ctest-vn-69584044 is 31.1.1.1 and allocation pool is NOT set 2025-03-22 02:38:59,977 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-54422518:ctest-vn-69584044 is 31.1.2.1 and allocation pool is NOT set 2025-03-22 02:39:02,049 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.79 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.62 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.617/4.201/6.785/2.584 ms') 2025-03-22 02:39:02,049 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-54422518-13384058 passed 2025-03-22 02:39:02,209 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:39:02,209 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-54422518-13384058, IP 31.1.1.4, Port 22 2025-03-22 02:39:02,276 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-03-22 02:39:02,369 - DEBUG - VM ctest-TestBasicVMVN-54422518-13384058 is NOT ready for SSH connections, VM status: ACTIVE 2025-03-22 02:39:07,370 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:39:07,370 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-54422518-13384058, IP 31.1.1.4, Port 22 2025-03-22 02:39:07,528 - DEBUG - VM ctest-TestBasicVMVN-54422518-13384058 is ready for SSH connections 2025-03-22 02:39:07,528 - INFO - Waiting for VM ctest-TestBasicVMVN-54422518-41413932 to be up.. 2025-03-22 02:39:07,617 - DEBUG - VM is in ACTIVE state now 2025-03-22 02:39:07,617 - INFO - VM name : ctest-TestBasicVMVN-54422518-41413932 2025-03-22 02:39:07,708 - DEBUG - VM ctest-TestBasicVMVN-54422518-41413932 ID is 818aac48-1365-4ec6-883b-56883d76e99c 2025-03-22 02:39:07,708 - DEBUG - VM ctest-TestBasicVMVN-54422518-41413932 launched on Node cn-jenkins-deploy-platform-ansible-os-2933-1 2025-03-22 02:39:07,797 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/818aac48-1365-4ec6-883b-56883d76e99c 2025-03-22 02:39:07,809 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/20a12068-a732-4df4-9aec-2ca8219972ce 2025-03-22 02:39:09,065 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.21 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.370 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.370/1.791/3.212/1.421 ms') 2025-03-22 02:39:09,065 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-54422518-41413932 passed 2025-03-22 02:39:09,221 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:39:09,221 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-54422518-41413932, IP 31.1.2.4, Port 22 2025-03-22 02:39:09,377 - DEBUG - VM ctest-TestBasicVMVN-54422518-41413932 is ready for SSH connections 2025-03-22 02:39:09,377 - INFO - Waiting for VM ctest-TestBasicVMVN-54422518-57780803 to be up.. 2025-03-22 02:39:09,462 - DEBUG - VM is in ACTIVE state now 2025-03-22 02:39:09,462 - INFO - VM name : ctest-TestBasicVMVN-54422518-57780803 2025-03-22 02:39:09,546 - DEBUG - VM ctest-TestBasicVMVN-54422518-57780803 ID is 9324587e-1018-4562-a226-48cc8db5541c 2025-03-22 02:39:09,546 - DEBUG - VM ctest-TestBasicVMVN-54422518-57780803 launched on Node cn-jenkins-deploy-platform-ansible-os-2933-1 2025-03-22 02:39:09,632 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/9324587e-1018-4562-a226-48cc8db5541c 2025-03-22 02:39:09,641 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/e1d3822b-afb0-49ea-aac6-77620199f11b 2025-03-22 02:39:10,888 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.00 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.558 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.558/1.777/2.997/1.219 ms') 2025-03-22 02:39:10,888 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-54422518-57780803 passed 2025-03-22 02:39:11,045 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:39:11,045 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-54422518-57780803, IP 31.1.1.3, Port 22 2025-03-22 02:39:11,201 - DEBUG - VM ctest-TestBasicVMVN-54422518-57780803 is ready for SSH connections 2025-03-22 02:39:11,201 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:39:11,201 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.28, gateway password: c0ntrail123 2025-03-22 02:39:11,201 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2025-03-22 02:39:15,303 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=5.083 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.949 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=1.000 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.949/2.344/5.083 ms 2025-03-22 02:39:15,303 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-54422518-13384058 passed 2025-03-22 02:39:15,303 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:39:15,304 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.28, gateway password: c0ntrail123 2025-03-22 02:39:15,304 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2025-03-22 02:39:19,043 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=4.247 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.984 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=0.992 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.984/2.074/4.247 ms 2025-03-22 02:39:19,043 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-54422518-41413932 passed 2025-03-22 02:39:19,043 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:39:19,043 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:39:19,043 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-22 02:39:19,043 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.28, gateway password: c0ntrail123 2025-03-22 02:39:19,044 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-03-22 02:39:19,232 - DEBUG - None 2025-03-22 02:39:19,232 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.28, gateway password: c0ntrail123 2025-03-22 02:39:19,232 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-03-22 02:39:19,431 - DEBUG - None 2025-03-22 02:39:19,432 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.28, gateway password: c0ntrail123 2025-03-22 02:39:19,432 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-03-22 02:39:20,095 - DEBUG - None 2025-03-22 02:39:20,096 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.28, gateway password: c0ntrail123 2025-03-22 02:39:20,096 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2025-03-22 02:39:22,322 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.485 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=5.983 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.464 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.847 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.641 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.464/2.284/5.983 ms 2025-03-22 02:39:22,322 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.28, gateway password: c0ntrail123 2025-03-22 02:39:22,322 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2025-03-22 02:39:24,586 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.149 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.521 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.764 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.619 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.064 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=3.028 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.650 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.619/2.256/4.764 ms 2025-03-22 02:39:24,586 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.28, gateway password: c0ntrail123 2025-03-22 02:39:24,586 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2025-03-22 02:39:26,847 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.729 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.814 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.888 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.443 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.836 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.901 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.410 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.410/2.145/4.888 ms 2025-03-22 02:39:26,848 - INFO - Deleting VM ctest-TestBasicVMVN-54422518-57780803 2025-03-22 02:39:26,925 - INFO - Detaching port 20a12068-a732-4df4-9aec-2ca8219972ce from VM ctest-TestBasicVMVN-54422518-41413932 2025-03-22 02:39:26,983 - INFO - Deleting VM ctest-TestBasicVMVN-54422518-41413932 2025-03-22 02:39:27,067 - INFO - Detaching port a1400a67-5e23-425d-9bfa-764454a55349 from VM ctest-TestBasicVMVN-54422518-13384058 2025-03-22 02:39:27,109 - INFO - Deleting VM ctest-TestBasicVMVN-54422518-13384058 2025-03-22 02:39:27,200 - INFO - Deleting VN ctest-vn-69584044 2025-03-22 02:39:27,395 - DEBUG - Response for delete_port : () 2025-03-22 02:39:27,652 - DEBUG - Response for delete_port : () 2025-03-22 02:39:27,707 - DEBUG - VN 03fe90de-3aba-46b7-9f02-ad314bd0d4d5 still in use: Unable to complete operation on network 03fe90de-3aba-46b7-9f02-ad314bd0d4d5. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-84a73359-0f5d-45cf-855e-7f98b70f8be3'] 2025-03-22 02:39:27,707 - WARNING - Deleting VN ctest-vn-69584044 failed..Will retry 2025-03-22 02:39:29,863 - DEBUG - Response for deleting network () 2025-03-22 02:39:29,863 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/0cb34ce1-e9df-4f8a-8102-6303225e8c0a 2025-03-22 02:39:29,870 - DEBUG - Response Code: 404 2025-03-22 02:39:29,871 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2025-03-22 02:39:29,877 - DEBUG - Requesting: http://10.0.0.28:8082/domain/7515f5f3-a6e3-4058-9d58-c95eec6d9d9a 2025-03-22 02:39:29,939 - DEBUG - Requesting: http://10.0.0.28:8082/project/65434176-2e03-4f85-8e75-ac49bed39760 2025-03-22 02:39:30,015 - INFO - Validated that VN ctest-vn-69584044 is not found in API Server 2025-03-22 02:39:30,027 - DEBUG - VN ctest-vn-69584044 is not present in Agent 10.0.0.28 2025-03-22 02:39:30,027 - INFO - Validated that VN ctest-vn-69584044 is not in any agent 2025-03-22 02:39:30,033 - DEBUG - VRF 2 is not seen in agent 10.0.0.28 2025-03-22 02:39:30,041 - DEBUG - Vrouter 10.0.0.28 does not have vrf 2 for VN ctest-vn-69584044 2025-03-22 02:39:30,041 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-54422518:ctest-vn-69584044 2025-03-22 02:39:30,057 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-69584044 info 2025-03-22 02:39:30,140 - INFO - IPAM: ctest-ipam-68742831 is not found in API Server 2025-03-22 02:39:30,153 - INFO - IPAM:ctest-ipam-68742831 is not found in control node 2025-03-22 02:39:30,418 - DEBUG - No XMPP flaps were noticed during the test 2025-03-22 02:39:30,418 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:43] 2025-03-22 02:39:30,418 - INFO - -------------------------------------------------------------------------------- 2025-03-22 02:39:31,137 - INFO - Deleted project: ctest-TestBasicVMVN-54422518, ID : 65434176-2e03-4f85-8e75-ac49bed39760