2025-04-18 14:25:30,295 - INFO - Domain Default found not creating 2025-04-18 14:25:30,473 - INFO - Project ctest-TestBasicVMVN-72010635 not found, creating it 2025-04-18 14:25:30,994 - INFO - Created Project:ctest-TestBasicVMVN-72010635, ID : cc31e858-b94b-4cbd-8b40-258a36463050 2025-04-18 14:25:32,669 - INFO - ================================================================================ 2025-04-18 14:25:32,669 - INFO - STARTING TEST : test_generic_link_local_service 2025-04-18 14:25:32,669 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-04-18 14:25:32,942 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.0.0.254': '0'}} with 2025-04-18 14:25:32,943 - INFO - Initial checks done. Running the testcase now 2025-04-18 14:25:32,943 - INFO - 2025-04-18 14:25:33,538 - DEBUG - Response for create_network : {'network': {'id': 'e1bb822a-9570-450f-a477-ff3050ad8b14', 'name': 'ctest-vn2_metadata-68174209', 'tenant_id': 'cc31e858b94b4cbd8b40258a36463050', 'project_id': 'cc31e858b94b4cbd8b40258a36463050', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-72010635', 'ctest-vn2_metadata-68174209'], 'port_security_enabled': True, 'description': ''}} 2025-04-18 14:25:33,736 - DEBUG - Response for create_subnet : {'subnet': {'id': '112abbd8-ea42-4b22-847d-7ef09c0ac0e2', 'name': '', 'tenant_id': 'cc31e858b94b4cbd8b40258a36463050', 'network_id': 'e1bb822a-9570-450f-a477-ff3050ad8b14', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'cc31e858b94b4cbd8b40258a36463050'}} 2025-04-18 14:25:33,757 - INFO - Created VN ctest-vn2_metadata-68174209 2025-04-18 14:25:33,808 - DEBUG - VN ctest-vn2_metadata-68174209 UUID is e1bb822a-9570-450f-a477-ff3050ad8b14 2025-04-18 14:25:34,016 - DEBUG - Services list from nova: [, , ] 2025-04-18 14:25:35,109 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3140-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3140-1) 2025-04-18 14:25:35,216 - DEBUG - Link local service introspect added 2025-04-18 14:25:35,263 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-04-18 14:25:40,397 - DEBUG - VM is in ACTIVE state now 2025-04-18 14:25:40,558 - INFO - Waiting for VM ctest-TestBasicVMVN-72010635-50635282 to be up.. 2025-04-18 14:25:40,559 - INFO - VM name : ctest-TestBasicVMVN-72010635-50635282 2025-04-18 14:25:40,650 - DEBUG - VM ctest-TestBasicVMVN-72010635-50635282 ID is ff6ef3c2-bca5-49dd-8973-283d353b506e 2025-04-18 14:25:40,651 - DEBUG - VM ctest-TestBasicVMVN-72010635-50635282 launched on Node cn-jenkins-deploy-platform-ansible-os-3140-1. 2025-04-18 14:25:40,766 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/ff6ef3c2-bca5-49dd-8973-283d353b506e 2025-04-18 14:25:41,064 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/ff6ef3c2-bca5-49dd-8973-283d353b506e 2025-04-18 14:25:41,096 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/d1adf948-490e-4a4f-bf2a-99286a5f2fd1 2025-04-18 14:25:44,354 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-04-18 14:25:44,355 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-72010635-50635282 failed! 2025-04-18 14:25:44,413 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-72010635:ctest-vn2_metadata-68174209 is 11.1.1.1 and allocation pool is NOT set 2025-04-18 14:25:46,475 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.52 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.591 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.591/4.554/8.518/3.963 ms') 2025-04-18 14:25:46,475 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-72010635-50635282 passed 2025-04-18 14:25:46,636 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-18 14:25:46,637 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-72010635-50635282, IP 11.1.1.3, Port 22 2025-04-18 14:25:46,803 - DEBUG - VM ctest-TestBasicVMVN-72010635-50635282 is ready for SSH connections 2025-04-18 14:25:46,803 - INFO - Retry 0 2025-04-18 14:25:46,803 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.254, gateway password: c0ntrail123 2025-04-18 14:25:46,803 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-04-18 14:25:48,525 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-04-18 14:25:48,525 - INFO - Generic metadata worked 2025-04-18 14:25:48,796 - DEBUG - Link local service introspect removed 2025-04-18 14:25:48,796 - INFO - Deleting VM ctest-TestBasicVMVN-72010635-50635282 2025-04-18 14:25:48,904 - INFO - Deleting VN ctest-vn2_metadata-68174209 2025-04-18 14:25:48,961 - DEBUG - VN e1bb822a-9570-450f-a477-ff3050ad8b14 still in use: Unable to complete operation on network e1bb822a-9570-450f-a477-ff3050ad8b14. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-9ecc4827-7c6f-4204-ac3e-5a22f7af7591'] 2025-04-18 14:25:48,961 - WARNING - Deleting VN ctest-vn2_metadata-68174209 failed..Will retry 2025-04-18 14:25:51,089 - DEBUG - Response for deleting network () 2025-04-18 14:25:51,358 - DEBUG - No XMPP flaps were noticed during the test 2025-04-18 14:25:51,359 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:19] 2025-04-18 14:25:51,359 - INFO - -------------------------------------------------------------------------------- 2025-04-18 14:25:51,363 - INFO - ================================================================================ 2025-04-18 14:25:51,363 - INFO - STARTING TEST : test_metadata_service 2025-04-18 14:25:51,363 - INFO - TEST DESCRIPTION : Description: Test to validate metadata service on VM creation. 1.Verify from global-vrouter-config if metadata configures or not - fails otherwise 2.Create a shell script which writes 'hello world ' in a file in /tmp and save the script on the nova api node 3.Create a vm with userdata pointing to that script - script should get executed during vm boot up 4.Go to the vm and verify if the file with 'hello world ' written saved in /tmp of the vm - fails otherwise Maintainer: sandipd@juniper.net 2025-04-18 14:25:51,660 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.0.0.254': '0'}} with 2025-04-18 14:25:51,660 - INFO - Initial checks done. Running the testcase now 2025-04-18 14:25:51,661 - INFO - 2025-04-18 14:25:51,661 - DEBUG - Requesting: http://10.0.0.254:8082/global-vrouter-configs 2025-04-18 14:25:51,669 - DEBUG - Requesting: http://10.0.0.254:8082/global-vrouter-config/234f6be2-fe71-4687-88cb-ef3dede99251 2025-04-18 14:25:51,933 - DEBUG - Response for create_network : {'network': {'id': '0d1ead78-0202-4589-ae5f-dbe8f011a0af', 'name': 'ctest-vn-14535808', 'tenant_id': 'cc31e858b94b4cbd8b40258a36463050', 'project_id': 'cc31e858b94b4cbd8b40258a36463050', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-72010635', 'ctest-vn-14535808'], 'port_security_enabled': True, 'description': ''}} 2025-04-18 14:25:52,181 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ce01248b-fc52-4885-91ce-d57caf488bd2', 'name': '', 'tenant_id': 'cc31e858b94b4cbd8b40258a36463050', 'network_id': '0d1ead78-0202-4589-ae5f-dbe8f011a0af', 'ip_version': 4, 'cidr': '198.91.92.0/26', 'allocation_pools': [{'start': '198.91.92.2', 'end': '198.91.92.62'}], 'gateway_ip': '198.91.92.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '198.91.92.2', 'tags': [], 'project_id': 'cc31e858b94b4cbd8b40258a36463050'}} 2025-04-18 14:25:52,204 - INFO - Created VN ctest-vn-14535808 2025-04-18 14:25:52,264 - DEBUG - VN ctest-vn-14535808 UUID is 0d1ead78-0202-4589-ae5f-dbe8f011a0af 2025-04-18 14:25:53,570 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3140-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3140-1) 2025-04-18 14:25:53,570 - INFO - Waiting for VM ctest-TestBasicVMVN-72010635-02507434 to be up.. 2025-04-18 14:25:53,623 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-04-18 14:25:58,714 - DEBUG - VM is in ACTIVE state now 2025-04-18 14:25:58,714 - INFO - VM name : ctest-TestBasicVMVN-72010635-02507434 2025-04-18 14:25:58,802 - DEBUG - VM ctest-TestBasicVMVN-72010635-02507434 ID is 147570ab-0ccc-4dd1-896f-0c41d771741a 2025-04-18 14:25:58,802 - DEBUG - VM ctest-TestBasicVMVN-72010635-02507434 launched on Node cn-jenkins-deploy-platform-ansible-os-3140-1. 2025-04-18 14:25:58,899 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/147570ab-0ccc-4dd1-896f-0c41d771741a 2025-04-18 14:25:58,908 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/88856c2f-126b-47f3-8966-bec82f4c85bf 2025-04-18 14:26:02,177 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2025-04-18 14:26:02,177 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-72010635-02507434 failed! 2025-04-18 14:26:02,240 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-14535808 is 198.91.92.1 and allocation pool is NOT set 2025-04-18 14:26:04,300 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=10.6 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.76 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.756/6.701/10.646/3.945 ms') 2025-04-18 14:26:04,300 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-72010635-02507434 passed 2025-04-18 14:26:04,453 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-18 14:26:04,453 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-72010635-02507434, IP 198.91.92.3, Port 22 2025-04-18 14:26:04,609 - DEBUG - VM ctest-TestBasicVMVN-72010635-02507434 is ready for SSH connections 2025-04-18 14:26:04,609 - DEBUG - Running remote_cmd, Cmd : cat /tmp/output.txt, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.254, gateway password: c0ntrail123 2025-04-18 14:26:04,609 - DEBUG - cat /tmp/output.txt 2025-04-18 14:26:06,274 - DEBUG - Hello World. The time is now Fri, 18 Apr 2025 08:26:04 -0600! 2025-04-18 14:26:06,275 - DEBUG - ret : {'cat /tmp/output.txt': 'Hello World. The time is now Fri, 18 Apr 2025 08:26:04 -0600!'} 2025-04-18 14:26:06,275 - INFO - metadata_script.txt got executed in the vm 2025-04-18 14:26:06,275 - INFO - Deleting VM ctest-TestBasicVMVN-72010635-02507434 2025-04-18 14:26:06,371 - INFO - Deleting VN ctest-vn-14535808 2025-04-18 14:26:06,423 - DEBUG - VN 0d1ead78-0202-4589-ae5f-dbe8f011a0af still in use: Unable to complete operation on network 0d1ead78-0202-4589-ae5f-dbe8f011a0af. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-4b3f063b-df55-4a7a-af02-c288e65d8ad9'] 2025-04-18 14:26:06,423 - WARNING - Deleting VN ctest-vn-14535808 failed..Will retry 2025-04-18 14:26:08,550 - DEBUG - Response for deleting network () 2025-04-18 14:26:08,824 - DEBUG - No XMPP flaps were noticed during the test 2025-04-18 14:26:08,825 - INFO - END TEST : test_metadata_service : PASSED[0:00:17] 2025-04-18 14:26:08,825 - INFO - -------------------------------------------------------------------------------- 2025-04-18 14:26:08,828 - INFO - ================================================================================ 2025-04-18 14:26:08,828 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-04-18 14:26:08,828 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-04-18 14:26:09,113 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.0.0.254': '0'}} with 2025-04-18 14:26:09,113 - INFO - Initial checks done. Running the testcase now 2025-04-18 14:26:09,114 - INFO - 2025-04-18 14:26:09,655 - DEBUG - Response for create_network : {'network': {'id': 'e3f4726c-ff46-45f7-b2c7-9974a63b9758', 'name': 'ctest-vn-34607748', 'tenant_id': 'cc31e858b94b4cbd8b40258a36463050', 'project_id': 'cc31e858b94b4cbd8b40258a36463050', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-72010635', 'ctest-vn-34607748'], 'port_security_enabled': True, 'description': ''}} 2025-04-18 14:26:09,838 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f1a41461-c71c-4033-8638-f77253740051', 'name': '', 'tenant_id': 'cc31e858b94b4cbd8b40258a36463050', 'network_id': 'e3f4726c-ff46-45f7-b2c7-9974a63b9758', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'cc31e858b94b4cbd8b40258a36463050'}} 2025-04-18 14:26:10,003 - DEBUG - Response for create_subnet : {'subnet': {'id': '289944b2-77f3-4e66-94aa-195b86e40104', 'name': '', 'tenant_id': 'cc31e858b94b4cbd8b40258a36463050', 'network_id': 'e3f4726c-ff46-45f7-b2c7-9974a63b9758', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'cc31e858b94b4cbd8b40258a36463050'}} 2025-04-18 14:26:10,027 - INFO - Created VN ctest-vn-34607748 2025-04-18 14:26:10,084 - DEBUG - VN ctest-vn-34607748 UUID is e3f4726c-ff46-45f7-b2c7-9974a63b9758 2025-04-18 14:26:10,481 - DEBUG - Response for create_port : {'port': {'name': '4b712b7d-4a5a-4f4e-9c26-df617694a753', 'id': '4b712b7d-4a5a-4f4e-9c26-df617694a753', 'tenant_id': 'cc31e858b94b4cbd8b40258a36463050', 'network_id': 'e3f4726c-ff46-45f7-b2c7-9974a63b9758', 'mac_address': '02:4b:71:2b:7d:4a', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': 'f1a41461-c71c-4033-8638-f77253740051'}], 'security_groups': ['f349bf04-7940-4185-aedd-6cfdd9af6a38'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'cc31e858b94b4cbd8b40258a36463050'}} 2025-04-18 14:26:10,711 - DEBUG - Response for create_port : {'port': {'name': '2779f76d-e6e2-4590-a94e-8ad4f3fd5488', 'id': '2779f76d-e6e2-4590-a94e-8ad4f3fd5488', 'tenant_id': 'cc31e858b94b4cbd8b40258a36463050', 'network_id': 'e3f4726c-ff46-45f7-b2c7-9974a63b9758', 'mac_address': '02:27:79:f7:6d:e6', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': '289944b2-77f3-4e66-94aa-195b86e40104'}], 'security_groups': ['f349bf04-7940-4185-aedd-6cfdd9af6a38'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'cc31e858b94b4cbd8b40258a36463050'}} 2025-04-18 14:26:11,122 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3140-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3140-1) 2025-04-18 14:26:11,610 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3140-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3140-1) 2025-04-18 14:26:12,984 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3140-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3140-1) 2025-04-18 14:26:12,984 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-04-18 14:26:12,992 - DEBUG - Requesting: http://10.0.0.254:8082/domain/d82b7f05-3d9b-49e0-a456-b1cf62e77f98 2025-04-18 14:26:13,006 - DEBUG - Requesting: http://10.0.0.254:8082/project/cc31e858-b94b-4cbd-8b40-258a36463050 2025-04-18 14:26:13,084 - DEBUG - Requesting: http://10.0.0.254:8082/network-ipam/3fb38956-1cd5-4185-9100-38ef3a283680 2025-04-18 14:26:13,102 - INFO - Verifications in API Server for IPAM: ctest-ipam-68167824 passed 2025-04-18 14:26:13,108 - DEBUG - Control-node 10.0.0.254 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-72010635:ctest-ipam-68167824', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-72010635', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4590163448164598149', 'uuid-lslong': '10448413735623603840'}, 'enable': 'true', 'created': '2025-04-18T14:26:09', 'last-modified': '2025-04-18T14:26:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.752359'} 2025-04-18 14:26:13,109 - INFO - Verifications in Control node for IPAM: ctest-ipam-68167824 passed 2025-04-18 14:26:13,109 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-04-18 14:26:13,115 - DEBUG - Requesting: http://10.0.0.254:8082/domain/d82b7f05-3d9b-49e0-a456-b1cf62e77f98 2025-04-18 14:26:13,129 - DEBUG - Requesting: http://10.0.0.254:8082/project/cc31e858-b94b-4cbd-8b40-258a36463050 2025-04-18 14:26:13,229 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/e3f4726c-ff46-45f7-b2c7-9974a63b9758 2025-04-18 14:26:13,246 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/e3f4726c-ff46-45f7-b2c7-9974a63b9758 2025-04-18 14:26:13,267 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/72330838-862f-4ec1-8e2a-2ecbd60381ab 2025-04-18 14:26:13,279 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/72330838-862f-4ec1-8e2a-2ecbd60381ab 2025-04-18 14:26:13,290 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/7a3600ba-4c6c-4cd4-8974-d5bdc9dc146c 2025-04-18 14:26:13,308 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-04-18 14:26:13,308 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/e3f4726c-ff46-45f7-b2c7-9974a63b9758 2025-04-18 14:26:13,320 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/72330838-862f-4ec1-8e2a-2ecbd60381ab 2025-04-18 14:26:13,341 - INFO - Verified VN network id 7 for VN e3f4726c-ff46-45f7-b2c7-9974a63b9758 2025-04-18 14:26:13,341 - INFO - Verifications in API Server for VN ctest-vn-34607748 passed 2025-04-18 14:26:13,341 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/e3f4726c-ff46-45f7-b2c7-9974a63b9758 2025-04-18 14:26:13,353 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/72330838-862f-4ec1-8e2a-2ecbd60381ab 2025-04-18 14:26:13,362 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/72330838-862f-4ec1-8e2a-2ecbd60381ab 2025-04-18 14:26:13,372 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/7a3600ba-4c6c-4cd4-8974-d5bdc9dc146c 2025-04-18 14:26:13,393 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-72010635', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16425879553391871479', 'uuid-lslong': '12882433985400772440'}, 'enable': 'true', 'created': '2025-04-18T14:26:09', 'last-modified': '2025-04-18T14:26:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.417416'} 2025-04-18 14:26:13,400 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-04-18 14:26:13,400 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-34607748 passed 2025-04-18 14:26:13,400 - DEBUG - ====Verifying policy data for ctest-vn-34607748 in API_Server ====== 2025-04-18 14:26:13,400 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-04-18 14:26:13,411 - DEBUG - Requesting: http://10.0.0.254:8082/domain/d82b7f05-3d9b-49e0-a456-b1cf62e77f98 2025-04-18 14:26:13,424 - DEBUG - Requesting: http://10.0.0.254:8082/project/cc31e858-b94b-4cbd-8b40-258a36463050 2025-04-18 14:26:13,550 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/e3f4726c-ff46-45f7-b2c7-9974a63b9758 2025-04-18 14:26:13,572 - DEBUG - =>VN ctest-vn-34607748 has no policy to be verified 2025-04-18 14:26:13,573 - DEBUG - Verifying the vn in opserver 2025-04-18 14:26:13,573 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:13,573 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:14,025 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:17,122 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:17,122 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:20,134 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:20,134 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:23,146 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:23,146 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:26,158 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:26,158 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:29,170 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:29,170 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:32,182 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:32,182 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:35,194 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:35,194 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:38,205 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:38,206 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:41,217 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:41,217 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:44,229 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:44,229 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:47,242 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:47,242 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:50,254 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:50,255 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:53,267 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:53,267 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:56,279 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:56,279 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:59,293 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72010635:ctest-vn-34607748 virtual network link through opserver 10.0.0.254 2025-04-18 14:26:59,294 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-04-18 14:26:59,309 - ERROR - One or more verifications in OpServer for VN ctest-vn-34607748 failed 2025-04-18 14:26:59,310 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-72010635-37338828 in state BUILD 2025-04-18 14:26:59,311 - INFO - Deleting VM ctest-TestBasicVMVN-72010635-37338828 2025-04-18 14:26:59,311 - ERROR - VM ctest-TestBasicVMVN-72010635-37338828 has failed to come up 2025-04-18 14:26:59,311 - ERROR - Nova failed to get host of the VM 2025-04-18 14:26:59,411 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-72010635-54584983 in state BUILD 2025-04-18 14:26:59,412 - INFO - Deleting VM ctest-TestBasicVMVN-72010635-54584983 2025-04-18 14:26:59,412 - ERROR - VM ctest-TestBasicVMVN-72010635-54584983 has failed to come up 2025-04-18 14:26:59,412 - ERROR - Nova failed to get host of the VM 2025-04-18 14:26:59,506 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-72010635-32664037 in state BUILD 2025-04-18 14:26:59,507 - INFO - Deleting VM ctest-TestBasicVMVN-72010635-32664037 2025-04-18 14:26:59,507 - ERROR - VM ctest-TestBasicVMVN-72010635-32664037 has failed to come up 2025-04-18 14:26:59,508 - ERROR - Nova failed to get host of the VM 2025-04-18 14:26:59,606 - INFO - Deleting VN ctest-vn-34607748 2025-04-18 14:26:59,796 - DEBUG - Response for delete_port : () 2025-04-18 14:26:59,974 - DEBUG - Response for delete_port : () 2025-04-18 14:27:00,026 - DEBUG - VN e3f4726c-ff46-45f7-b2c7-9974a63b9758 still in use: Unable to complete operation on network e3f4726c-ff46-45f7-b2c7-9974a63b9758. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-47fdebc0-1d3e-44ff-9014-7c1dd1b127ef'] 2025-04-18 14:27:00,026 - WARNING - Deleting VN ctest-vn-34607748 failed..Will retry 2025-04-18 14:27:02,184 - DEBUG - Response for deleting network () 2025-04-18 14:27:02,282 - INFO - IPAM: ctest-ipam-68167824 is not found in API Server 2025-04-18 14:27:02,300 - INFO - IPAM:ctest-ipam-68167824 is not found in control node 2025-04-18 14:27:02,560 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Fri Apr 18 14:26:59 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/vm_regression/test_vm_basic.py in test_ping_within_vn_two_vms_two_different_subnets(self=) 144 vm3 = self.create_vm(image_name='cirros', vn_fixture=vn1_fixture) 145 assert ipam_obj.verify_on_setup() 146 assert vn1_fixture.verify_on_setup() 147 assert vm1.wait_till_vm_is_up() 148 assert vm2.wait_till_vm_is_up() vn1_fixture = vn1_fixture.verify_on_setup = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 146, in test_ping_within_vn_two_vms_two_different_subnets assert vn1_fixture.verify_on_setup() AssertionError 2025-04-18 14:27:02,570 - DEBUG - No XMPP flaps were noticed during the test 2025-04-18 14:27:02,570 - INFO - 2025-04-18 14:27:02,571 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : FAILED[0:00:54] 2025-04-18 14:27:02,571 - INFO - -------------------------------------------------------------------------------- 2025-04-18 14:27:03,292 - INFO - Deleted project: ctest-TestBasicVMVN-72010635, ID : cc31e858-b94b-4cbd-8b40-258a36463050