2024-09-17 16:31:36,064 - INFO - Domain Default found not creating 2024-09-17 16:31:36,262 - INFO - Project ctest-TestBasicVMVN-74938052 not found, creating it 2024-09-17 16:31:36,756 - INFO - Created Project:ctest-TestBasicVMVN-74938052, ID : d87ce9ef-a30a-4e17-be08-4533cc3acfd5 2024-09-17 16:31:38,662 - INFO - ================================================================================ 2024-09-17 16:31:38,662 - INFO - STARTING TEST : test_generic_link_local_service 2024-09-17 16:31:38,662 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2024-09-17 16:31:38,924 - DEBUG - Nothing to compare xmpp stats {'10.0.0.59': {'10.20.0.24': '0'}} with 2024-09-17 16:31:38,924 - INFO - Initial checks done. Running the testcase now 2024-09-17 16:31:38,924 - INFO - 2024-09-17 16:31:39,927 - DEBUG - Response for create_network : {'network': {'id': 'd3eda498-5dde-41f9-8c41-a0aeeabd5502', 'name': 'ctest-vn2_metadata-76929556', 'tenant_id': 'd87ce9efa30a4e17be084533cc3acfd5', 'project_id': 'd87ce9efa30a4e17be084533cc3acfd5', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-74938052', 'ctest-vn2_metadata-76929556'], 'port_security_enabled': True, 'description': ''}} 2024-09-17 16:31:40,160 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f2ed8055-4286-4e55-a894-39af1af75f8d', 'name': '', 'tenant_id': 'd87ce9efa30a4e17be084533cc3acfd5', 'network_id': 'd3eda498-5dde-41f9-8c41-a0aeeabd5502', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'd87ce9efa30a4e17be084533cc3acfd5'}} 2024-09-17 16:31:40,182 - INFO - Created VN ctest-vn2_metadata-76929556 2024-09-17 16:31:40,242 - DEBUG - VN ctest-vn2_metadata-76929556 UUID is d3eda498-5dde-41f9-8c41-a0aeeabd5502 2024-09-17 16:31:40,463 - DEBUG - Services list from nova: [, , ] 2024-09-17 16:31:41,771 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1965-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1965-1) 2024-09-17 16:31:41,886 - DEBUG - Link local service introspect added 2024-09-17 16:31:41,934 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-09-17 16:31:47,031 - DEBUG - VM is in ACTIVE state now 2024-09-17 16:31:47,162 - INFO - Waiting for VM ctest-TestBasicVMVN-74938052-21892231 to be up.. 2024-09-17 16:31:47,162 - INFO - VM name : ctest-TestBasicVMVN-74938052-21892231 2024-09-17 16:31:47,259 - DEBUG - VM ctest-TestBasicVMVN-74938052-21892231 ID is 463ece00-d13b-4520-a399-ec146fe94abc 2024-09-17 16:31:47,259 - DEBUG - VM ctest-TestBasicVMVN-74938052-21892231 launched on Node cn-jenkins-deploy-platform-ansible-os-1965-1 2024-09-17 16:31:47,352 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine/463ece00-d13b-4520-a399-ec146fe94abc 2024-09-17 16:31:47,705 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine/463ece00-d13b-4520-a399-ec146fe94abc 2024-09-17 16:31:47,745 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine-interface/aa36315b-255e-498c-9031-eec0eee96dee 2024-09-17 16:31:51,032 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2024-09-17 16:31:51,032 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-74938052-21892231 failed! 2024-09-17 16:31:51,098 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-74938052:ctest-vn2_metadata-76929556 is 11.1.1.1 and allocation pool is NOT set 2024-09-17 16:31:53,167 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=14.7 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.75 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.747/8.215/14.684/6.468 ms') 2024-09-17 16:31:53,167 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-74938052-21892231 passed 2024-09-17 16:31:53,338 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-17 16:31:53,338 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-74938052-21892231, IP 11.1.1.3, Port 22 2024-09-17 16:31:53,404 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-09-17 16:31:53,509 - DEBUG - VM ctest-TestBasicVMVN-74938052-21892231 is NOT ready for SSH connections, VM status: ACTIVE 2024-09-17 16:31:58,509 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-17 16:31:58,509 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-74938052-21892231, IP 11.1.1.3, Port 22 2024-09-17 16:31:58,665 - DEBUG - VM ctest-TestBasicVMVN-74938052-21892231 is ready for SSH connections 2024-09-17 16:31:58,665 - INFO - Retry 0 2024-09-17 16:31:58,665 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2024-09-17 16:31:58,666 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2024-09-17 16:32:00,361 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2024-09-17 16:32:00,361 - INFO - Generic metadata worked 2024-09-17 16:32:00,614 - DEBUG - Link local service introspect removed 2024-09-17 16:32:00,614 - INFO - Deleting VM ctest-TestBasicVMVN-74938052-21892231 2024-09-17 16:32:00,691 - INFO - Deleting VN ctest-vn2_metadata-76929556 2024-09-17 16:32:00,739 - DEBUG - VN d3eda498-5dde-41f9-8c41-a0aeeabd5502 still in use: Unable to complete operation on network d3eda498-5dde-41f9-8c41-a0aeeabd5502. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-e2492ceb-1c42-4fb3-98c4-048b0825e391'] 2024-09-17 16:32:00,739 - WARNING - Deleting VN ctest-vn2_metadata-76929556 failed..Will retry 2024-09-17 16:32:02,861 - DEBUG - Response for deleting network () 2024-09-17 16:32:03,116 - DEBUG - No XMPP flaps were noticed during the test 2024-09-17 16:32:03,116 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:25] 2024-09-17 16:32:03,116 - INFO - -------------------------------------------------------------------------------- 2024-09-17 16:32:03,119 - INFO - ================================================================================ 2024-09-17 16:32:03,119 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2024-09-17 16:32:03,120 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2024-09-17 16:32:03,412 - DEBUG - Nothing to compare xmpp stats {'10.0.0.59': {'10.20.0.24': '0'}} with 2024-09-17 16:32:03,412 - INFO - Initial checks done. Running the testcase now 2024-09-17 16:32:03,412 - INFO - 2024-09-17 16:32:04,023 - DEBUG - Response for create_network : {'network': {'id': 'e8d99e8d-7730-4154-8e0b-621f801383e5', 'name': 'ctest-vn-15009142', 'tenant_id': 'd87ce9efa30a4e17be084533cc3acfd5', 'project_id': 'd87ce9efa30a4e17be084533cc3acfd5', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-74938052', 'ctest-vn-15009142'], 'port_security_enabled': True, 'description': ''}} 2024-09-17 16:32:04,263 - DEBUG - Response for create_subnet : {'subnet': {'id': '7713b914-97b0-425a-910c-2a62f2c22d22', 'name': '', 'tenant_id': 'd87ce9efa30a4e17be084533cc3acfd5', 'network_id': 'e8d99e8d-7730-4154-8e0b-621f801383e5', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'd87ce9efa30a4e17be084533cc3acfd5'}} 2024-09-17 16:32:04,437 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b3c3800d-34df-47de-914a-d65207d5da6b', 'name': '', 'tenant_id': 'd87ce9efa30a4e17be084533cc3acfd5', 'network_id': 'e8d99e8d-7730-4154-8e0b-621f801383e5', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'd87ce9efa30a4e17be084533cc3acfd5'}} 2024-09-17 16:32:04,461 - INFO - Created VN ctest-vn-15009142 2024-09-17 16:32:04,526 - DEBUG - VN ctest-vn-15009142 UUID is e8d99e8d-7730-4154-8e0b-621f801383e5 2024-09-17 16:32:04,952 - DEBUG - Response for create_port : {'port': {'name': '19959855-c000-4713-a20f-d5ac548e957e', 'id': '19959855-c000-4713-a20f-d5ac548e957e', 'tenant_id': 'd87ce9efa30a4e17be084533cc3acfd5', 'network_id': 'e8d99e8d-7730-4154-8e0b-621f801383e5', 'mac_address': '02:19:95:98:55:c0', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '7713b914-97b0-425a-910c-2a62f2c22d22'}], 'security_groups': ['8bbdc49b-4d48-4b0d-8036-798fb50eead8'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'd87ce9efa30a4e17be084533cc3acfd5'}} 2024-09-17 16:32:05,163 - DEBUG - Response for create_port : {'port': {'name': 'd084cb80-dc7c-4780-85df-78a0a05264c4', 'id': 'd084cb80-dc7c-4780-85df-78a0a05264c4', 'tenant_id': 'd87ce9efa30a4e17be084533cc3acfd5', 'network_id': 'e8d99e8d-7730-4154-8e0b-621f801383e5', 'mac_address': '02:d0:84:cb:80:dc', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'b3c3800d-34df-47de-914a-d65207d5da6b'}], 'security_groups': ['8bbdc49b-4d48-4b0d-8036-798fb50eead8'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'd87ce9efa30a4e17be084533cc3acfd5'}} 2024-09-17 16:32:05,592 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1965-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1965-1) 2024-09-17 16:32:06,028 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1965-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1965-1) 2024-09-17 16:32:07,384 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1965-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1965-1) 2024-09-17 16:32:07,385 - DEBUG - Requesting: http://10.0.0.59:8082/domains 2024-09-17 16:32:07,396 - DEBUG - Requesting: http://10.0.0.59:8082/domain/79811cd8-eb8a-4a2d-abe1-83a89e491162 2024-09-17 16:32:07,419 - DEBUG - Requesting: http://10.0.0.59:8082/project/d87ce9ef-a30a-4e17-be08-4533cc3acfd5 2024-09-17 16:32:07,547 - DEBUG - Requesting: http://10.0.0.59:8082/network-ipam/a10987d3-53c9-4e4b-9b76-31a78f28173d 2024-09-17 16:32:07,561 - INFO - Verifications in API Server for IPAM: ctest-ipam-53683230 passed 2024-09-17 16:32:07,569 - DEBUG - Control-node 10.0.0.59 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-74938052:ctest-ipam-53683230', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-74938052', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11603955256610344523', 'uuid-lslong': '11202195718861756221'}, 'enable': 'true', 'created': '2024-09-17T16:32:03', 'last-modified': '2024-09-17T16:32:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.917120'} 2024-09-17 16:32:07,569 - INFO - Verifications in Control node for IPAM: ctest-ipam-53683230 passed 2024-09-17 16:32:07,569 - DEBUG - Requesting: http://10.0.0.59:8082/domains 2024-09-17 16:32:07,579 - DEBUG - Requesting: http://10.0.0.59:8082/domain/79811cd8-eb8a-4a2d-abe1-83a89e491162 2024-09-17 16:32:07,600 - DEBUG - Requesting: http://10.0.0.59:8082/project/d87ce9ef-a30a-4e17-be08-4533cc3acfd5 2024-09-17 16:32:07,705 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-network/e8d99e8d-7730-4154-8e0b-621f801383e5 2024-09-17 16:32:07,732 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-network/e8d99e8d-7730-4154-8e0b-621f801383e5 2024-09-17 16:32:07,759 - DEBUG - Requesting: http://10.0.0.59:8082/routing-instance/d0716f64-47c0-4bed-8963-0916e254d0e2 2024-09-17 16:32:07,774 - DEBUG - Requesting: http://10.0.0.59:8082/routing-instance/d0716f64-47c0-4bed-8963-0916e254d0e2 2024-09-17 16:32:07,795 - DEBUG - Requesting: http://10.0.0.59:8082/route-target/2cf46c48-fea4-4766-93ef-ed73f9e03ede 2024-09-17 16:32:07,807 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-17 16:32:07,807 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-network/e8d99e8d-7730-4154-8e0b-621f801383e5 2024-09-17 16:32:07,824 - DEBUG - Requesting: http://10.0.0.59:8082/routing-instance/d0716f64-47c0-4bed-8963-0916e254d0e2 2024-09-17 16:32:07,850 - INFO - Verified VN network id 8 for VN e8d99e8d-7730-4154-8e0b-621f801383e5 2024-09-17 16:32:07,850 - INFO - Verifications in API Server for VN ctest-vn-15009142 passed 2024-09-17 16:32:07,850 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-network/e8d99e8d-7730-4154-8e0b-621f801383e5 2024-09-17 16:32:07,867 - DEBUG - Requesting: http://10.0.0.59:8082/routing-instance/d0716f64-47c0-4bed-8963-0916e254d0e2 2024-09-17 16:32:07,895 - DEBUG - Requesting: http://10.0.0.59:8082/routing-instance/d0716f64-47c0-4bed-8963-0916e254d0e2 2024-09-17 16:32:07,910 - DEBUG - Requesting: http://10.0.0.59:8082/route-target/2cf46c48-fea4-4766-93ef-ed73f9e03ede 2024-09-17 16:32:07,941 - DEBUG - Control-node 10.0.0.59 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-74938052:ctest-vn-15009142', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-74938052', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16778616217172722004', 'uuid-lslong': '10235382465561854949'}, 'enable': 'true', 'created': '2024-09-17T16:32:03', 'last-modified': '2024-09-17T16:32:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.549836'} 2024-09-17 16:32:07,950 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-17 16:32:07,950 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-15009142 passed 2024-09-17 16:32:07,950 - DEBUG - ====Verifying policy data for ctest-vn-15009142 in API_Server ====== 2024-09-17 16:32:07,950 - DEBUG - Requesting: http://10.0.0.59:8082/domains 2024-09-17 16:32:07,969 - DEBUG - Requesting: http://10.0.0.59:8082/domain/79811cd8-eb8a-4a2d-abe1-83a89e491162 2024-09-17 16:32:07,993 - DEBUG - Requesting: http://10.0.0.59:8082/project/d87ce9ef-a30a-4e17-be08-4533cc3acfd5 2024-09-17 16:32:08,082 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-network/e8d99e8d-7730-4154-8e0b-621f801383e5 2024-09-17 16:32:08,100 - DEBUG - =>VN ctest-vn-15009142 has no policy to be verified 2024-09-17 16:32:08,100 - DEBUG - Verifying the vn in opserver 2024-09-17 16:32:08,100 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-74938052:ctest-vn-15009142 virtual network link through opserver 10.0.0.59 2024-09-17 16:32:08,100 - DEBUG - Requesting: http://10.0.0.59:8081/analytics/uves/virtual-networks 2024-09-17 16:32:08,514 - DEBUG - Requesting: http://10.0.0.59:8081/analytics/uves/virtual-networks 2024-09-17 16:32:08,635 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-74938052:ctest-vn-15009142', 'href': 'http://10.0.0.59:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-74938052:ctest-vn-15009142?flat'} 2024-09-17 16:32:08,635 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-74938052:ctest-vn-15009142 is found in opserver 2024-09-17 16:32:08,644 - DEBUG - VRF ids for VN ctest-vn-15009142: {'10.0.0.59': '2'} 2024-09-17 16:32:08,644 - INFO - Waiting for VM ctest-TestBasicVMVN-74938052-16114124 to be up.. 2024-09-17 16:32:08,784 - DEBUG - VM is in ACTIVE state now 2024-09-17 16:32:08,784 - INFO - VM name : ctest-TestBasicVMVN-74938052-16114124 2024-09-17 16:32:08,920 - DEBUG - VM ctest-TestBasicVMVN-74938052-16114124 ID is 5f5e847e-a50b-4d90-a592-2cdf3332f8a3 2024-09-17 16:32:08,920 - DEBUG - VM ctest-TestBasicVMVN-74938052-16114124 launched on Node cn-jenkins-deploy-platform-ansible-os-1965-1 2024-09-17 16:32:09,036 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine/5f5e847e-a50b-4d90-a592-2cdf3332f8a3 2024-09-17 16:32:09,055 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine-interface/19959855-c000-4713-a20f-d5ac548e957e 2024-09-17 16:32:12,350 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2024-09-17 16:32:12,350 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-74938052-16114124 failed! 2024-09-17 16:32:12,426 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-74938052:ctest-vn-15009142 is 31.1.1.1 and allocation pool is NOT set 2024-09-17 16:32:12,426 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-74938052:ctest-vn-15009142 is 31.1.2.1 and allocation pool is NOT set 2024-09-17 16:32:16,510 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2024-09-17 16:32:16,510 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-74938052-16114124 failed! 2024-09-17 16:32:16,574 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-74938052:ctest-vn-15009142 is 31.1.1.1 and allocation pool is NOT set 2024-09-17 16:32:16,574 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-74938052:ctest-vn-15009142 is 31.1.2.1 and allocation pool is NOT set 2024-09-17 16:32:18,636 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.33 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.574 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.574/3.452/6.330/2.878 ms') 2024-09-17 16:32:18,636 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-74938052-16114124 passed 2024-09-17 16:32:18,802 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-17 16:32:18,802 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-74938052-16114124, IP 31.1.1.4, Port 22 2024-09-17 16:32:18,868 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-09-17 16:32:18,959 - DEBUG - VM ctest-TestBasicVMVN-74938052-16114124 is NOT ready for SSH connections, VM status: ACTIVE 2024-09-17 16:32:23,960 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-17 16:32:23,960 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-74938052-16114124, IP 31.1.1.4, Port 22 2024-09-17 16:32:24,117 - DEBUG - VM ctest-TestBasicVMVN-74938052-16114124 is ready for SSH connections 2024-09-17 16:32:24,117 - INFO - Waiting for VM ctest-TestBasicVMVN-74938052-20088046 to be up.. 2024-09-17 16:32:24,212 - DEBUG - VM is in ACTIVE state now 2024-09-17 16:32:24,212 - INFO - VM name : ctest-TestBasicVMVN-74938052-20088046 2024-09-17 16:32:24,299 - DEBUG - VM ctest-TestBasicVMVN-74938052-20088046 ID is caf3de03-9fd8-41f8-a991-cceb25405d61 2024-09-17 16:32:24,299 - DEBUG - VM ctest-TestBasicVMVN-74938052-20088046 launched on Node cn-jenkins-deploy-platform-ansible-os-1965-1 2024-09-17 16:32:24,387 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine/caf3de03-9fd8-41f8-a991-cceb25405d61 2024-09-17 16:32:24,399 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine-interface/d084cb80-dc7c-4780-85df-78a0a05264c4 2024-09-17 16:32:25,653 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.11 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.451 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.451/1.779/3.108/1.328 ms') 2024-09-17 16:32:25,654 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-74938052-20088046 passed 2024-09-17 16:32:25,814 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-17 16:32:25,814 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-74938052-20088046, IP 31.1.2.4, Port 22 2024-09-17 16:32:25,973 - DEBUG - VM ctest-TestBasicVMVN-74938052-20088046 is ready for SSH connections 2024-09-17 16:32:25,973 - INFO - Waiting for VM ctest-TestBasicVMVN-74938052-45516779 to be up.. 2024-09-17 16:32:26,060 - DEBUG - VM is in ACTIVE state now 2024-09-17 16:32:26,060 - INFO - VM name : ctest-TestBasicVMVN-74938052-45516779 2024-09-17 16:32:26,151 - DEBUG - VM ctest-TestBasicVMVN-74938052-45516779 ID is 6b1f7839-0a7f-4238-ad58-16a77aff0457 2024-09-17 16:32:26,151 - DEBUG - VM ctest-TestBasicVMVN-74938052-45516779 launched on Node cn-jenkins-deploy-platform-ansible-os-1965-1 2024-09-17 16:32:26,240 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine/6b1f7839-0a7f-4238-ad58-16a77aff0457 2024-09-17 16:32:26,252 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine-interface/4291c19b-08f5-4720-96b9-239e5342fcca 2024-09-17 16:32:27,512 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.24 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.446 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.446/1.843/3.241/1.397 ms') 2024-09-17 16:32:27,512 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-74938052-45516779 passed 2024-09-17 16:32:27,670 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-17 16:32:27,670 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-74938052-45516779, IP 31.1.1.3, Port 22 2024-09-17 16:32:27,825 - DEBUG - VM ctest-TestBasicVMVN-74938052-45516779 is ready for SSH connections 2024-09-17 16:32:27,825 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-17 16:32:27,825 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2024-09-17 16:32:27,825 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2024-09-17 16:32:31,595 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.746 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.985 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=1.093 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.985/2.274/4.746 ms 2024-09-17 16:32:31,595 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-74938052-16114124 passed 2024-09-17 16:32:31,595 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-17 16:32:31,595 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2024-09-17 16:32:31,596 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2024-09-17 16:32:35,690 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=4.135 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.939 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=1.388 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.939/2.154/4.135 ms 2024-09-17 16:32:35,691 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-74938052-20088046 passed 2024-09-17 16:32:35,691 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-17 16:32:35,691 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-17 16:32:35,691 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-17 16:32:35,691 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2024-09-17 16:32:35,691 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-09-17 16:32:35,890 - DEBUG - None 2024-09-17 16:32:35,890 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2024-09-17 16:32:35,890 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-09-17 16:32:36,086 - DEBUG - None 2024-09-17 16:32:36,086 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2024-09-17 16:32:36,086 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-09-17 16:32:36,752 - DEBUG - None 2024-09-17 16:32:36,752 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2024-09-17 16:32:36,752 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2024-09-17 16:32:38,974 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.213 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=5.503 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.447 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.803 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.411 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.411/2.075/5.503 ms 2024-09-17 16:32:38,974 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2024-09-17 16:32:38,974 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2024-09-17 16:32:41,241 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.096 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.184 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.320 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.479 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.027 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.923 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.593 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.479/2.088/4.320 ms 2024-09-17 16:32:41,241 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2024-09-17 16:32:41,241 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2024-09-17 16:32:43,515 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.798 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=2.905 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.067 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.694 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=3.115 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=4.158 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.396 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.396/2.304/4.158 ms 2024-09-17 16:32:43,515 - INFO - Deleting VM ctest-TestBasicVMVN-74938052-45516779 2024-09-17 16:32:43,595 - INFO - Detaching port d084cb80-dc7c-4780-85df-78a0a05264c4 from VM ctest-TestBasicVMVN-74938052-20088046 2024-09-17 16:32:43,665 - INFO - Deleting VM ctest-TestBasicVMVN-74938052-20088046 2024-09-17 16:32:43,738 - INFO - Detaching port 19959855-c000-4713-a20f-d5ac548e957e from VM ctest-TestBasicVMVN-74938052-16114124 2024-09-17 16:32:43,779 - INFO - Deleting VM ctest-TestBasicVMVN-74938052-16114124 2024-09-17 16:32:43,854 - INFO - Deleting VN ctest-vn-15009142 2024-09-17 16:32:44,062 - DEBUG - Response for delete_port : () 2024-09-17 16:32:44,326 - DEBUG - Response for delete_port : () 2024-09-17 16:32:44,405 - DEBUG - VN e8d99e8d-7730-4154-8e0b-621f801383e5 still in use: Unable to complete operation on network e8d99e8d-7730-4154-8e0b-621f801383e5. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-49e73a17-f779-4cc5-8447-25804a3c774e'] 2024-09-17 16:32:44,405 - WARNING - Deleting VN ctest-vn-15009142 failed..Will retry 2024-09-17 16:32:46,560 - DEBUG - Response for deleting network () 2024-09-17 16:32:46,560 - DEBUG - Requesting: http://10.0.0.59:8082/routing-instance/d0716f64-47c0-4bed-8963-0916e254d0e2 2024-09-17 16:32:46,571 - DEBUG - Response Code: 404 2024-09-17 16:32:46,571 - DEBUG - Requesting: http://10.0.0.59:8082/domains 2024-09-17 16:32:46,580 - DEBUG - Requesting: http://10.0.0.59:8082/domain/79811cd8-eb8a-4a2d-abe1-83a89e491162 2024-09-17 16:32:46,639 - DEBUG - Requesting: http://10.0.0.59:8082/project/d87ce9ef-a30a-4e17-be08-4533cc3acfd5 2024-09-17 16:32:46,745 - INFO - Validated that VN ctest-vn-15009142 is not found in API Server 2024-09-17 16:32:46,758 - DEBUG - VN ctest-vn-15009142 is not present in Agent 10.0.0.59 2024-09-17 16:32:46,758 - INFO - Validated that VN ctest-vn-15009142 is not in any agent 2024-09-17 16:32:46,765 - DEBUG - VRF 2 is not seen in agent 10.0.0.59 2024-09-17 16:32:46,772 - DEBUG - Vrouter 10.0.0.59 does not have vrf 2 for VN ctest-vn-15009142 2024-09-17 16:32:46,772 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-74938052:ctest-vn-15009142 2024-09-17 16:32:46,789 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-15009142 info 2024-09-17 16:32:46,893 - INFO - IPAM: ctest-ipam-53683230 is not found in API Server 2024-09-17 16:32:46,907 - INFO - IPAM:ctest-ipam-53683230 is not found in control node 2024-09-17 16:32:47,164 - DEBUG - No XMPP flaps were noticed during the test 2024-09-17 16:32:47,165 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:44] 2024-09-17 16:32:47,165 - INFO - -------------------------------------------------------------------------------- 2024-09-17 16:32:47,971 - INFO - Deleted project: ctest-TestBasicVMVN-74938052, ID : d87ce9ef-a30a-4e17-be08-4533cc3acfd5