2025-08-13 14:59:58,586 - INFO - Domain Default found not creating 2025-08-13 14:59:58,744 - INFO - Project ctest-TestBasicVMVN-76691521 not found, creating it 2025-08-13 14:59:59,238 - INFO - Created Project:ctest-TestBasicVMVN-76691521, ID : 82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:00:00,725 - INFO - ================================================================================ 2025-08-13 15:00:00,725 - INFO - STARTING TEST : test_generic_link_local_service 2025-08-13 15:00:00,725 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-08-13 15:00:00,980 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.17': '0'}} with 2025-08-13 15:00:00,981 - INFO - Initial checks done. Running the testcase now 2025-08-13 15:00:00,981 - INFO - 2025-08-13 15:00:01,564 - DEBUG - Response for create_network : {'network': {'id': '73149c44-cc7e-47b4-83d8-4be84b60a76e', 'name': 'ctest-vn2_metadata-45813096', 'tenant_id': '82f4f8c19d6c4a7a89521ea2e8aa7299', 'project_id': '82f4f8c19d6c4a7a89521ea2e8aa7299', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-76691521', 'ctest-vn2_metadata-45813096'], 'port_security_enabled': True, 'description': ''}} 2025-08-13 15:00:01,770 - DEBUG - Response for create_subnet : {'subnet': {'id': '2ffad9b7-81ae-4ad6-90ed-034b05733614', 'name': '', 'tenant_id': '82f4f8c19d6c4a7a89521ea2e8aa7299', 'network_id': '73149c44-cc7e-47b4-83d8-4be84b60a76e', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '82f4f8c19d6c4a7a89521ea2e8aa7299'}} 2025-08-13 15:00:01,792 - INFO - Created VN ctest-vn2_metadata-45813096 2025-08-13 15:00:01,846 - DEBUG - VN ctest-vn2_metadata-45813096 UUID is 73149c44-cc7e-47b4-83d8-4be84b60a76e 2025-08-13 15:00:02,043 - DEBUG - Services list from nova: [, , ] 2025-08-13 15:00:03,163 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3839-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3839-1) 2025-08-13 15:00:03,274 - DEBUG - Link local service introspect added 2025-08-13 15:00:03,318 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-13 15:00:08,414 - DEBUG - VM is in ACTIVE state now 2025-08-13 15:00:08,549 - INFO - Waiting for VM ctest-TestBasicVMVN-76691521-69002179 to be up.. 2025-08-13 15:00:08,549 - INFO - VM name : ctest-TestBasicVMVN-76691521-69002179 2025-08-13 15:00:08,634 - DEBUG - VM ctest-TestBasicVMVN-76691521-69002179 ID is 70db58bb-8beb-4ce6-b40e-199df2694756 2025-08-13 15:00:08,634 - DEBUG - VM ctest-TestBasicVMVN-76691521-69002179 launched on Node cn-jenkins-deploy-platform-ansible-os-3839-1 2025-08-13 15:00:08,714 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/70db58bb-8beb-4ce6-b40e-199df2694756 2025-08-13 15:00:09,040 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/70db58bb-8beb-4ce6-b40e-199df2694756 2025-08-13 15:00:09,073 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/c0923f68-7e2e-4e35-8bf1-102ff6acdd47 2025-08-13 15:00:12,329 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-13 15:00:12,329 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-76691521-69002179 failed! 2025-08-13 15:00:12,390 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-76691521:ctest-vn2_metadata-45813096 is 11.1.1.1 and allocation pool is NOT set 2025-08-13 15:00:14,454 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.10 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.800 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.800/4.947/9.095/4.147 ms') 2025-08-13 15:00:14,454 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-76691521-69002179 passed 2025-08-13 15:00:14,602 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-13 15:00:14,602 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-76691521-69002179, IP 11.1.1.3, Port 22 2025-08-13 15:00:14,758 - DEBUG - VM ctest-TestBasicVMVN-76691521-69002179 is ready for SSH connections 2025-08-13 15:00:14,758 - INFO - Retry 0 2025-08-13 15:00:14,758 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 15:00:14,758 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-08-13 15:00:16,690 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-08-13 15:00:16,690 - INFO - Generic metadata worked 2025-08-13 15:00:16,946 - DEBUG - Link local service introspect removed 2025-08-13 15:00:16,946 - INFO - Deleting VM ctest-TestBasicVMVN-76691521-69002179 2025-08-13 15:00:17,018 - INFO - Deleting VN ctest-vn2_metadata-45813096 2025-08-13 15:00:17,056 - DEBUG - VN 73149c44-cc7e-47b4-83d8-4be84b60a76e still in use: Unable to complete operation on network 73149c44-cc7e-47b4-83d8-4be84b60a76e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-715bfda7-59ea-466f-9771-3543470a66f7'] 2025-08-13 15:00:17,057 - WARNING - Deleting VN ctest-vn2_metadata-45813096 failed..Will retry 2025-08-13 15:00:19,158 - DEBUG - Response for deleting network () 2025-08-13 15:00:19,411 - DEBUG - No XMPP flaps were noticed during the test 2025-08-13 15:00:19,411 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:19] 2025-08-13 15:00:19,411 - INFO - -------------------------------------------------------------------------------- 2025-08-13 15:00:19,414 - INFO - ================================================================================ 2025-08-13 15:00:19,414 - INFO - STARTING TEST : test_metadata_service 2025-08-13 15:00:19,414 - INFO - TEST DESCRIPTION : Description: Test to validate metadata service on VM creation. 1.Verify from global-vrouter-config if metadata configures or not - fails otherwise 2.Create a shell script which writes 'hello world ' in a file in /tmp and save the script on the nova api node 3.Create a vm with userdata pointing to that script - script should get executed during vm boot up 4.Go to the vm and verify if the file with 'hello world ' written saved in /tmp of the vm - fails otherwise Maintainer: sandipd@juniper.net 2025-08-13 15:00:19,699 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.17': '0'}} with 2025-08-13 15:00:19,700 - INFO - Initial checks done. Running the testcase now 2025-08-13 15:00:19,700 - INFO - 2025-08-13 15:00:19,700 - DEBUG - Requesting: http://10.0.0.27:8082/global-vrouter-configs 2025-08-13 15:00:19,706 - DEBUG - Requesting: http://10.0.0.27:8082/global-vrouter-config/0d8f57ce-6b66-4ceb-9bb8-cd9984196b9e 2025-08-13 15:00:19,911 - DEBUG - Response for create_network : {'network': {'id': '7b089bb0-f595-4955-8ad1-dc6f671eb1d8', 'name': 'ctest-vn-18076520', 'tenant_id': '82f4f8c19d6c4a7a89521ea2e8aa7299', 'project_id': '82f4f8c19d6c4a7a89521ea2e8aa7299', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-76691521', 'ctest-vn-18076520'], 'port_security_enabled': True, 'description': ''}} 2025-08-13 15:00:20,066 - DEBUG - Response for create_subnet : {'subnet': {'id': '8f9c934b-4670-4865-90d9-151daad59bde', 'name': '', 'tenant_id': '82f4f8c19d6c4a7a89521ea2e8aa7299', 'network_id': '7b089bb0-f595-4955-8ad1-dc6f671eb1d8', 'ip_version': 4, 'cidr': '11.67.151.192/26', 'allocation_pools': [{'start': '11.67.151.194', 'end': '11.67.151.254'}], 'gateway_ip': '11.67.151.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.67.151.194', 'tags': [], 'project_id': '82f4f8c19d6c4a7a89521ea2e8aa7299'}} 2025-08-13 15:00:20,086 - INFO - Created VN ctest-vn-18076520 2025-08-13 15:00:20,142 - DEBUG - VN ctest-vn-18076520 UUID is 7b089bb0-f595-4955-8ad1-dc6f671eb1d8 2025-08-13 15:00:21,377 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3839-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3839-1) 2025-08-13 15:00:21,377 - INFO - Waiting for VM ctest-TestBasicVMVN-76691521-28444264 to be up.. 2025-08-13 15:00:21,418 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-13 15:00:26,501 - DEBUG - VM is in ACTIVE state now 2025-08-13 15:00:26,501 - INFO - VM name : ctest-TestBasicVMVN-76691521-28444264 2025-08-13 15:00:26,587 - DEBUG - VM ctest-TestBasicVMVN-76691521-28444264 ID is 249db93c-81a4-48dd-bb32-9a42a1dcd13c 2025-08-13 15:00:26,587 - DEBUG - VM ctest-TestBasicVMVN-76691521-28444264 launched on Node cn-jenkins-deploy-platform-ansible-os-3839-1 2025-08-13 15:00:26,669 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/249db93c-81a4-48dd-bb32-9a42a1dcd13c 2025-08-13 15:00:26,679 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/d071e61d-acb5-4ea2-bfdb-6185f2e32093 2025-08-13 15:00:29,934 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-13 15:00:29,934 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-76691521-28444264 failed! 2025-08-13 15:00:29,994 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-76691521:ctest-vn-18076520 is 11.67.151.193 and allocation pool is NOT set 2025-08-13 15:00:32,063 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.77 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.43 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.430/2.102/2.774/0.672 ms') 2025-08-13 15:00:32,063 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-76691521-28444264 passed 2025-08-13 15:00:32,218 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-13 15:00:32,218 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-76691521-28444264, IP 11.67.151.195, Port 22 2025-08-13 15:00:32,386 - DEBUG - VM ctest-TestBasicVMVN-76691521-28444264 is ready for SSH connections 2025-08-13 15:00:32,386 - DEBUG - Running remote_cmd, Cmd : cat /tmp/output.txt, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 15:00:32,386 - DEBUG - cat /tmp/output.txt 2025-08-13 15:00:34,023 - DEBUG - Hello World. The time is now Wed, 13 Aug 2025 09:00:31 -0600! 2025-08-13 15:00:34,023 - DEBUG - ret : {'cat /tmp/output.txt': 'Hello World. The time is now Wed, 13 Aug 2025 09:00:31 -0600!'} 2025-08-13 15:00:34,023 - INFO - metadata_script.txt got executed in the vm 2025-08-13 15:00:34,023 - INFO - Deleting VM ctest-TestBasicVMVN-76691521-28444264 2025-08-13 15:00:34,086 - INFO - Deleting VN ctest-vn-18076520 2025-08-13 15:00:34,121 - DEBUG - VN 7b089bb0-f595-4955-8ad1-dc6f671eb1d8 still in use: Unable to complete operation on network 7b089bb0-f595-4955-8ad1-dc6f671eb1d8. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-6970eeb5-8ef5-46ea-9f70-a4e700031f15'] 2025-08-13 15:00:34,121 - WARNING - Deleting VN ctest-vn-18076520 failed..Will retry 2025-08-13 15:00:36,221 - DEBUG - Response for deleting network () 2025-08-13 15:00:36,477 - DEBUG - No XMPP flaps were noticed during the test 2025-08-13 15:00:36,477 - INFO - END TEST : test_metadata_service : PASSED[0:00:17] 2025-08-13 15:00:36,477 - INFO - -------------------------------------------------------------------------------- 2025-08-13 15:00:36,480 - INFO - ================================================================================ 2025-08-13 15:00:36,480 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-08-13 15:00:36,480 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-08-13 15:00:36,764 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.17': '0'}} with 2025-08-13 15:00:36,764 - INFO - Initial checks done. Running the testcase now 2025-08-13 15:00:36,764 - INFO - 2025-08-13 15:00:37,270 - DEBUG - Response for create_network : {'network': {'id': '0623223c-573f-43bc-a2ee-9fc0ab074bea', 'name': 'ctest-vn-43463813', 'tenant_id': '82f4f8c19d6c4a7a89521ea2e8aa7299', 'project_id': '82f4f8c19d6c4a7a89521ea2e8aa7299', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-76691521', 'ctest-vn-43463813'], 'port_security_enabled': True, 'description': ''}} 2025-08-13 15:00:37,417 - DEBUG - Response for create_subnet : {'subnet': {'id': '5e88feba-61a2-4775-9e66-bd36bdbfd0e6', 'name': '', 'tenant_id': '82f4f8c19d6c4a7a89521ea2e8aa7299', 'network_id': '0623223c-573f-43bc-a2ee-9fc0ab074bea', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': '82f4f8c19d6c4a7a89521ea2e8aa7299'}} 2025-08-13 15:00:37,635 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ce47e6f4-9603-4bd7-a1ba-c01e83ca1628', 'name': '', 'tenant_id': '82f4f8c19d6c4a7a89521ea2e8aa7299', 'network_id': '0623223c-573f-43bc-a2ee-9fc0ab074bea', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': '82f4f8c19d6c4a7a89521ea2e8aa7299'}} 2025-08-13 15:00:37,657 - INFO - Created VN ctest-vn-43463813 2025-08-13 15:00:37,710 - DEBUG - VN ctest-vn-43463813 UUID is 0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:00:38,105 - DEBUG - Response for create_port : {'port': {'name': '2a041f69-d8aa-41e4-8a39-26b0a760a17b', 'id': '2a041f69-d8aa-41e4-8a39-26b0a760a17b', 'tenant_id': '82f4f8c19d6c4a7a89521ea2e8aa7299', 'network_id': '0623223c-573f-43bc-a2ee-9fc0ab074bea', 'mac_address': '02:2a:04:1f:69:d8', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '5e88feba-61a2-4775-9e66-bd36bdbfd0e6'}], 'security_groups': ['d2a7a496-05b7-483f-a74f-056b63a1f0be'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '82f4f8c19d6c4a7a89521ea2e8aa7299'}} 2025-08-13 15:00:38,286 - DEBUG - Response for create_port : {'port': {'name': '92f5b8b7-8982-4494-8cea-cf5023aba61f', 'id': '92f5b8b7-8982-4494-8cea-cf5023aba61f', 'tenant_id': '82f4f8c19d6c4a7a89521ea2e8aa7299', 'network_id': '0623223c-573f-43bc-a2ee-9fc0ab074bea', 'mac_address': '02:92:f5:b8:b7:89', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'ce47e6f4-9603-4bd7-a1ba-c01e83ca1628'}], 'security_groups': ['d2a7a496-05b7-483f-a74f-056b63a1f0be'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '82f4f8c19d6c4a7a89521ea2e8aa7299'}} 2025-08-13 15:00:38,646 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3839-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3839-1) 2025-08-13 15:00:39,094 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3839-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3839-1) 2025-08-13 15:00:40,407 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3839-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3839-1) 2025-08-13 15:00:40,407 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-13 15:00:40,416 - DEBUG - Requesting: http://10.0.0.27:8082/domain/f3f7903d-7ed4-4776-b147-e6e40853bf2f 2025-08-13 15:00:40,431 - DEBUG - Requesting: http://10.0.0.27:8082/project/82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:00:40,517 - DEBUG - Requesting: http://10.0.0.27:8082/network-ipam/22ed4205-fb75-49e2-93b2-2a00fd639403 2025-08-13 15:00:40,534 - INFO - Verifications in API Server for IPAM: ctest-ipam-83457891 passed 2025-08-13 15:00:40,541 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-76691521:ctest-ipam-83457891', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-76691521', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2516740360231012834', 'uuid-lslong': '10642615053169431555'}, 'enable': 'true', 'created': '2025-08-13T15:00:36', 'last-modified': '2025-08-13T15:00:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.548630'} 2025-08-13 15:00:40,541 - INFO - Verifications in Control node for IPAM: ctest-ipam-83457891 passed 2025-08-13 15:00:40,541 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-13 15:00:40,549 - DEBUG - Requesting: http://10.0.0.27:8082/domain/f3f7903d-7ed4-4776-b147-e6e40853bf2f 2025-08-13 15:00:40,563 - DEBUG - Requesting: http://10.0.0.27:8082/project/82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:00:40,656 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:00:40,679 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:00:40,695 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:00:40,704 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:00:40,715 - DEBUG - Route Targets: [] 2025-08-13 15:00:40,715 - DEBUG - RT names not yet present for VN ctest-vn-43463813 2025-08-13 15:00:45,715 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-13 15:00:45,723 - DEBUG - Requesting: http://10.0.0.27:8082/domain/f3f7903d-7ed4-4776-b147-e6e40853bf2f 2025-08-13 15:00:45,736 - DEBUG - Requesting: http://10.0.0.27:8082/project/82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:00:45,821 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:00:45,840 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:00:45,858 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:00:45,870 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:00:45,880 - DEBUG - Route Targets: [] 2025-08-13 15:00:45,880 - DEBUG - RT names not yet present for VN ctest-vn-43463813 2025-08-13 15:00:50,881 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-13 15:00:50,888 - DEBUG - Requesting: http://10.0.0.27:8082/domain/f3f7903d-7ed4-4776-b147-e6e40853bf2f 2025-08-13 15:00:50,901 - DEBUG - Requesting: http://10.0.0.27:8082/project/82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:00:50,995 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:00:51,007 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:00:51,020 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:00:51,030 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:00:51,043 - DEBUG - Route Targets: [] 2025-08-13 15:00:51,043 - DEBUG - RT names not yet present for VN ctest-vn-43463813 2025-08-13 15:00:56,044 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-13 15:00:56,056 - DEBUG - Requesting: http://10.0.0.27:8082/domain/f3f7903d-7ed4-4776-b147-e6e40853bf2f 2025-08-13 15:00:56,113 - DEBUG - Requesting: http://10.0.0.27:8082/project/82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:00:56,196 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:00:56,208 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:00:56,219 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:00:56,227 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:00:56,234 - DEBUG - Route Targets: [] 2025-08-13 15:00:56,234 - DEBUG - RT names not yet present for VN ctest-vn-43463813 2025-08-13 15:01:01,234 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-13 15:01:01,241 - DEBUG - Requesting: http://10.0.0.27:8082/domain/f3f7903d-7ed4-4776-b147-e6e40853bf2f 2025-08-13 15:01:01,254 - DEBUG - Requesting: http://10.0.0.27:8082/project/82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:01:01,325 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:01,336 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:01,348 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:01,358 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:01,367 - DEBUG - Route Targets: [] 2025-08-13 15:01:01,367 - DEBUG - RT names not yet present for VN ctest-vn-43463813 2025-08-13 15:01:06,368 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-13 15:01:06,374 - DEBUG - Requesting: http://10.0.0.27:8082/domain/f3f7903d-7ed4-4776-b147-e6e40853bf2f 2025-08-13 15:01:06,387 - DEBUG - Requesting: http://10.0.0.27:8082/project/82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:01:06,455 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:06,467 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:06,478 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:06,485 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:06,492 - DEBUG - Route Targets: [] 2025-08-13 15:01:06,492 - DEBUG - RT names not yet present for VN ctest-vn-43463813 2025-08-13 15:01:11,493 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-13 15:01:11,500 - DEBUG - Requesting: http://10.0.0.27:8082/domain/f3f7903d-7ed4-4776-b147-e6e40853bf2f 2025-08-13 15:01:11,512 - DEBUG - Requesting: http://10.0.0.27:8082/project/82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:01:11,588 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:11,601 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:11,614 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:11,624 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:11,633 - DEBUG - Route Targets: [] 2025-08-13 15:01:11,633 - DEBUG - RT names not yet present for VN ctest-vn-43463813 2025-08-13 15:01:16,633 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-13 15:01:16,641 - DEBUG - Requesting: http://10.0.0.27:8082/domain/f3f7903d-7ed4-4776-b147-e6e40853bf2f 2025-08-13 15:01:16,654 - DEBUG - Requesting: http://10.0.0.27:8082/project/82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:01:16,738 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:16,751 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:16,765 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:16,774 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:16,782 - DEBUG - Route Targets: [] 2025-08-13 15:01:16,782 - DEBUG - RT names not yet present for VN ctest-vn-43463813 2025-08-13 15:01:21,782 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-13 15:01:21,789 - DEBUG - Requesting: http://10.0.0.27:8082/domain/f3f7903d-7ed4-4776-b147-e6e40853bf2f 2025-08-13 15:01:21,800 - DEBUG - Requesting: http://10.0.0.27:8082/project/82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:01:21,877 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:21,890 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:21,905 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:21,913 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:21,921 - DEBUG - Route Targets: [] 2025-08-13 15:01:21,921 - DEBUG - RT names not yet present for VN ctest-vn-43463813 2025-08-13 15:01:26,922 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-13 15:01:26,929 - DEBUG - Requesting: http://10.0.0.27:8082/domain/f3f7903d-7ed4-4776-b147-e6e40853bf2f 2025-08-13 15:01:26,940 - DEBUG - Requesting: http://10.0.0.27:8082/project/82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:01:27,013 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:27,024 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:27,035 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:27,043 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:27,051 - DEBUG - Route Targets: [] 2025-08-13 15:01:27,051 - DEBUG - RT names not yet present for VN ctest-vn-43463813 2025-08-13 15:01:32,052 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-13 15:01:32,059 - DEBUG - Requesting: http://10.0.0.27:8082/domain/f3f7903d-7ed4-4776-b147-e6e40853bf2f 2025-08-13 15:01:32,070 - DEBUG - Requesting: http://10.0.0.27:8082/project/82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299 2025-08-13 15:01:32,143 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:32,157 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0623223c-573f-43bc-a2ee-9fc0ab074bea 2025-08-13 15:01:32,170 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:32,178 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/104c65a0-49f9-40b8-a9cd-bb8d21c7d891 2025-08-13 15:01:32,187 - DEBUG - Route Targets: [] 2025-08-13 15:01:32,187 - DEBUG - RT names not yet present for VN ctest-vn-43463813 2025-08-13 15:01:32,187 - ERROR - One or more verifications in API Server for VN ctest-vn-43463813 failed 2025-08-13 15:01:32,189 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-76691521-01179281 in state BUILD 2025-08-13 15:01:32,189 - INFO - Deleting VM ctest-TestBasicVMVN-76691521-01179281 2025-08-13 15:01:32,189 - ERROR - VM ctest-TestBasicVMVN-76691521-01179281 has failed to come up 2025-08-13 15:01:32,189 - ERROR - Nova failed to get host of the VM 2025-08-13 15:01:32,256 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-76691521-03248318 in state BUILD 2025-08-13 15:01:32,256 - INFO - Deleting VM ctest-TestBasicVMVN-76691521-03248318 2025-08-13 15:01:32,256 - ERROR - VM ctest-TestBasicVMVN-76691521-03248318 has failed to come up 2025-08-13 15:01:32,256 - ERROR - Nova failed to get host of the VM 2025-08-13 15:01:32,320 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-76691521-42827900 in state BUILD 2025-08-13 15:01:32,321 - INFO - Deleting VM ctest-TestBasicVMVN-76691521-42827900 2025-08-13 15:01:32,321 - ERROR - VM ctest-TestBasicVMVN-76691521-42827900 has failed to come up 2025-08-13 15:01:32,321 - ERROR - Nova failed to get host of the VM 2025-08-13 15:01:32,386 - INFO - Deleting VN ctest-vn-43463813 2025-08-13 15:01:32,558 - DEBUG - Response for delete_port : () 2025-08-13 15:01:32,745 - DEBUG - Response for delete_port : () 2025-08-13 15:01:32,784 - DEBUG - VN 0623223c-573f-43bc-a2ee-9fc0ab074bea still in use: Unable to complete operation on network 0623223c-573f-43bc-a2ee-9fc0ab074bea. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-48229869-88bf-49b9-822d-404e6891f590'] 2025-08-13 15:01:32,784 - WARNING - Deleting VN ctest-vn-43463813 failed..Will retry 2025-08-13 15:01:34,978 - DEBUG - Response for deleting network () 2025-08-13 15:01:35,050 - INFO - IPAM: ctest-ipam-83457891 is not found in API Server 2025-08-13 15:01:35,063 - INFO - IPAM:ctest-ipam-83457891 is not found in control node 2025-08-13 15:01:35,314 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Wed Aug 13 15:01:32 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/vm_regression/test_vm_basic.py in test_ping_within_vn_two_vms_two_different_subnets(self=) 144 vm3 = self.create_vm(image_name='cirros', vn_fixture=vn1_fixture) 145 assert ipam_obj.verify_on_setup() 146 assert vn1_fixture.verify_on_setup() 147 assert vm1.wait_till_vm_is_up() 148 assert vm2.wait_till_vm_is_up() vn1_fixture = vn1_fixture.verify_on_setup = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 146, in test_ping_within_vn_two_vms_two_different_subnets assert vn1_fixture.verify_on_setup() AssertionError 2025-08-13 15:01:35,321 - DEBUG - No XMPP flaps were noticed during the test 2025-08-13 15:01:35,321 - INFO - 2025-08-13 15:01:35,321 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : FAILED[0:00:59] 2025-08-13 15:01:35,321 - INFO - -------------------------------------------------------------------------------- 2025-08-13 15:01:36,038 - INFO - Deleted project: ctest-TestBasicVMVN-76691521, ID : 82f4f8c1-9d6c-4a7a-8952-1ea2e8aa7299