2024-10-26 20:56:58,076 - INFO - Domain Default found not creating 2024-10-26 20:56:58,290 - INFO - Project ctest-TestBasicVMVN-87107353 not found, creating it 2024-10-26 20:56:58,872 - INFO - Created Project:ctest-TestBasicVMVN-87107353, ID : ff93a077-fbec-41c8-ae37-22f9b453e1c9 2024-10-26 20:57:00,717 - INFO - ================================================================================ 2024-10-26 20:57:00,717 - INFO - STARTING TEST : test_generic_link_local_service 2024-10-26 20:57:00,717 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2024-10-26 20:57:00,999 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.19': '0'}} with 2024-10-26 20:57:00,999 - INFO - Initial checks done. Running the testcase now 2024-10-26 20:57:00,999 - INFO - 2024-10-26 20:57:01,663 - DEBUG - Response for create_network : {'network': {'id': '6f70bda0-3483-47a0-9c39-b39ebdf47ce0', 'name': 'ctest-vn2_metadata-49436827', 'tenant_id': 'ff93a077fbec41c8ae3722f9b453e1c9', 'project_id': 'ff93a077fbec41c8ae3722f9b453e1c9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-87107353', 'ctest-vn2_metadata-49436827'], 'port_security_enabled': True, 'description': ''}} 2024-10-26 20:57:01,931 - DEBUG - Response for create_subnet : {'subnet': {'id': '15d048c5-025c-4e5b-a07a-c0b697d47386', 'name': '', 'tenant_id': 'ff93a077fbec41c8ae3722f9b453e1c9', 'network_id': '6f70bda0-3483-47a0-9c39-b39ebdf47ce0', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'ff93a077fbec41c8ae3722f9b453e1c9'}} 2024-10-26 20:57:01,957 - INFO - Created VN ctest-vn2_metadata-49436827 2024-10-26 20:57:02,018 - DEBUG - VN ctest-vn2_metadata-49436827 UUID is 6f70bda0-3483-47a0-9c39-b39ebdf47ce0 2024-10-26 20:57:02,260 - DEBUG - Services list from nova: [, , ] 2024-10-26 20:57:03,523 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2153-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2153-1) 2024-10-26 20:57:03,638 - DEBUG - Link local service introspect added 2024-10-26 20:57:03,693 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-10-26 20:57:08,781 - DEBUG - VM is in ACTIVE state now 2024-10-26 20:57:08,924 - INFO - Waiting for VM ctest-TestBasicVMVN-87107353-47484245 to be up.. 2024-10-26 20:57:08,924 - INFO - VM name : ctest-TestBasicVMVN-87107353-47484245 2024-10-26 20:57:09,018 - DEBUG - VM ctest-TestBasicVMVN-87107353-47484245 ID is c19cac13-8c79-4288-8ee0-9fe53ef8d57c 2024-10-26 20:57:09,018 - DEBUG - VM ctest-TestBasicVMVN-87107353-47484245 launched on Node cn-jenkins-deploy-platform-ansible-os-2153-1 2024-10-26 20:57:09,109 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/c19cac13-8c79-4288-8ee0-9fe53ef8d57c 2024-10-26 20:57:09,451 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/c19cac13-8c79-4288-8ee0-9fe53ef8d57c 2024-10-26 20:57:09,498 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/2b919e94-cf72-4208-a0a3-e25fbb9813a7 2024-10-26 20:57:12,794 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2024-10-26 20:57:12,795 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-87107353-47484245 failed! 2024-10-26 20:57:12,858 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-87107353:ctest-vn2_metadata-49436827 is 11.1.1.1 and allocation pool is NOT set 2024-10-26 20:57:16,920 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=7.65 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1005ms\r\nrtt min/avg/max/mdev = 7.647/7.647/7.647/0.000 ms') 2024-10-26 20:57:16,920 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-87107353-47484245 passed 2024-10-26 20:57:17,082 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-26 20:57:17,082 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-87107353-47484245, IP 11.1.1.3, Port 22 2024-10-26 20:57:17,238 - DEBUG - VM ctest-TestBasicVMVN-87107353-47484245 is ready for SSH connections 2024-10-26 20:57:17,238 - INFO - Retry 0 2024-10-26 20:57:17,238 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-10-26 20:57:17,238 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2024-10-26 20:57:19,331 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2024-10-26 20:57:19,331 - INFO - Generic metadata worked 2024-10-26 20:57:19,598 - DEBUG - Link local service introspect removed 2024-10-26 20:57:19,598 - INFO - Deleting VM ctest-TestBasicVMVN-87107353-47484245 2024-10-26 20:57:19,685 - INFO - Deleting VN ctest-vn2_metadata-49436827 2024-10-26 20:57:19,736 - DEBUG - VN 6f70bda0-3483-47a0-9c39-b39ebdf47ce0 still in use: Unable to complete operation on network 6f70bda0-3483-47a0-9c39-b39ebdf47ce0. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-e8d6d498-99e3-4f1c-8da3-4991d209998d'] 2024-10-26 20:57:19,736 - WARNING - Deleting VN ctest-vn2_metadata-49436827 failed..Will retry 2024-10-26 20:57:21,879 - DEBUG - Response for deleting network () 2024-10-26 20:57:22,137 - DEBUG - No XMPP flaps were noticed during the test 2024-10-26 20:57:22,137 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:22] 2024-10-26 20:57:22,137 - INFO - -------------------------------------------------------------------------------- 2024-10-26 20:57:22,140 - INFO - ================================================================================ 2024-10-26 20:57:22,140 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2024-10-26 20:57:22,140 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2024-10-26 20:57:22,429 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.19': '0'}} with 2024-10-26 20:57:22,429 - INFO - Initial checks done. Running the testcase now 2024-10-26 20:57:22,429 - INFO - 2024-10-26 20:57:23,002 - DEBUG - Response for create_network : {'network': {'id': '9f69196e-d1fa-4b5d-a382-ec2c5f538766', 'name': 'ctest-vn-50179424', 'tenant_id': 'ff93a077fbec41c8ae3722f9b453e1c9', 'project_id': 'ff93a077fbec41c8ae3722f9b453e1c9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-87107353', 'ctest-vn-50179424'], 'port_security_enabled': True, 'description': ''}} 2024-10-26 20:57:23,228 - DEBUG - Response for create_subnet : {'subnet': {'id': 'dc42fb97-18f8-446e-930b-2bed868d6b86', 'name': '', 'tenant_id': 'ff93a077fbec41c8ae3722f9b453e1c9', 'network_id': '9f69196e-d1fa-4b5d-a382-ec2c5f538766', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'ff93a077fbec41c8ae3722f9b453e1c9'}} 2024-10-26 20:57:23,429 - DEBUG - Response for create_subnet : {'subnet': {'id': '807dd1cf-0858-4e08-8b5c-7c9977748d0a', 'name': '', 'tenant_id': 'ff93a077fbec41c8ae3722f9b453e1c9', 'network_id': '9f69196e-d1fa-4b5d-a382-ec2c5f538766', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'ff93a077fbec41c8ae3722f9b453e1c9'}} 2024-10-26 20:57:23,452 - INFO - Created VN ctest-vn-50179424 2024-10-26 20:57:23,510 - DEBUG - VN ctest-vn-50179424 UUID is 9f69196e-d1fa-4b5d-a382-ec2c5f538766 2024-10-26 20:57:23,945 - DEBUG - Response for create_port : {'port': {'name': '95ea06f7-82fa-4d6f-836e-c16baaa42cb2', 'id': '95ea06f7-82fa-4d6f-836e-c16baaa42cb2', 'tenant_id': 'ff93a077fbec41c8ae3722f9b453e1c9', 'network_id': '9f69196e-d1fa-4b5d-a382-ec2c5f538766', 'mac_address': '02:95:ea:06:f7:82', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': 'dc42fb97-18f8-446e-930b-2bed868d6b86'}], 'security_groups': ['f0a16ab8-c0f8-4c5e-b6f7-4f45f8a68e32'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'ff93a077fbec41c8ae3722f9b453e1c9'}} 2024-10-26 20:57:24,147 - DEBUG - Response for create_port : {'port': {'name': '79be73da-d700-4fcc-a9f9-351a25001b25', 'id': '79be73da-d700-4fcc-a9f9-351a25001b25', 'tenant_id': 'ff93a077fbec41c8ae3722f9b453e1c9', 'network_id': '9f69196e-d1fa-4b5d-a382-ec2c5f538766', 'mac_address': '02:79:be:73:da:d7', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': '807dd1cf-0858-4e08-8b5c-7c9977748d0a'}], 'security_groups': ['f0a16ab8-c0f8-4c5e-b6f7-4f45f8a68e32'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'ff93a077fbec41c8ae3722f9b453e1c9'}} 2024-10-26 20:57:24,586 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2153-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2153-1) 2024-10-26 20:57:25,077 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2153-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2153-1) 2024-10-26 20:57:26,545 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2153-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2153-1) 2024-10-26 20:57:26,545 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-26 20:57:26,555 - DEBUG - Requesting: http://10.0.0.27:8082/domain/5665a368-f59a-40ee-918b-1fce15fa1435 2024-10-26 20:57:26,587 - DEBUG - Requesting: http://10.0.0.27:8082/project/ff93a077-fbec-41c8-ae37-22f9b453e1c9 2024-10-26 20:57:26,720 - DEBUG - Requesting: http://10.0.0.27:8082/network-ipam/8428e1c1-1096-470d-818d-03e1d8d1192a 2024-10-26 20:57:26,739 - INFO - Verifications in API Server for IPAM: ctest-ipam-21037675 passed 2024-10-26 20:57:26,751 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-87107353:ctest-ipam-21037675', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-87107353', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9523109631398135565', 'uuid-lslong': '9335121871149013290'}, 'enable': 'true', 'created': '2024-10-26T20:57:22', 'last-modified': '2024-10-26T20:57:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.073073'} 2024-10-26 20:57:26,751 - INFO - Verifications in Control node for IPAM: ctest-ipam-21037675 passed 2024-10-26 20:57:26,751 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-26 20:57:26,771 - DEBUG - Requesting: http://10.0.0.27:8082/domain/5665a368-f59a-40ee-918b-1fce15fa1435 2024-10-26 20:57:26,797 - DEBUG - Requesting: http://10.0.0.27:8082/project/ff93a077-fbec-41c8-ae37-22f9b453e1c9 2024-10-26 20:57:26,898 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9f69196e-d1fa-4b5d-a382-ec2c5f538766 2024-10-26 20:57:26,931 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9f69196e-d1fa-4b5d-a382-ec2c5f538766 2024-10-26 20:57:26,949 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e830ee28-4893-4bec-b4c3-f108ba09a503 2024-10-26 20:57:26,965 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e830ee28-4893-4bec-b4c3-f108ba09a503 2024-10-26 20:57:26,978 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/5c0ca87d-9e71-4e56-a592-7b3496417dcd 2024-10-26 20:57:26,995 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-10-26 20:57:26,995 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9f69196e-d1fa-4b5d-a382-ec2c5f538766 2024-10-26 20:57:27,026 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e830ee28-4893-4bec-b4c3-f108ba09a503 2024-10-26 20:57:27,057 - INFO - Verified VN network id 8 for VN 9f69196e-d1fa-4b5d-a382-ec2c5f538766 2024-10-26 20:57:27,058 - INFO - Verifications in API Server for VN ctest-vn-50179424 passed 2024-10-26 20:57:27,058 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9f69196e-d1fa-4b5d-a382-ec2c5f538766 2024-10-26 20:57:27,075 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e830ee28-4893-4bec-b4c3-f108ba09a503 2024-10-26 20:57:27,091 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e830ee28-4893-4bec-b4c3-f108ba09a503 2024-10-26 20:57:27,109 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/5c0ca87d-9e71-4e56-a592-7b3496417dcd 2024-10-26 20:57:27,152 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-87107353:ctest-vn-50179424', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-87107353', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11486740288345099101', 'uuid-lslong': '11782239250476664678'}, 'enable': 'true', 'created': '2024-10-26T20:57:22', 'last-modified': '2024-10-26T20:57:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.757716'} 2024-10-26 20:57:27,164 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-10-26 20:57:27,164 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-50179424 passed 2024-10-26 20:57:27,164 - DEBUG - ====Verifying policy data for ctest-vn-50179424 in API_Server ====== 2024-10-26 20:57:27,165 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-26 20:57:27,174 - DEBUG - Requesting: http://10.0.0.27:8082/domain/5665a368-f59a-40ee-918b-1fce15fa1435 2024-10-26 20:57:27,206 - DEBUG - Requesting: http://10.0.0.27:8082/project/ff93a077-fbec-41c8-ae37-22f9b453e1c9 2024-10-26 20:57:27,342 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9f69196e-d1fa-4b5d-a382-ec2c5f538766 2024-10-26 20:57:27,382 - DEBUG - =>VN ctest-vn-50179424 has no policy to be verified 2024-10-26 20:57:27,382 - DEBUG - Verifying the vn in opserver 2024-10-26 20:57:27,382 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-87107353:ctest-vn-50179424 virtual network link through opserver 10.0.0.27 2024-10-26 20:57:27,382 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2024-10-26 20:57:27,803 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2024-10-26 20:57:27,901 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-87107353:ctest-vn-50179424', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-87107353:ctest-vn-50179424?flat'} 2024-10-26 20:57:27,901 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-87107353:ctest-vn-50179424 is found in opserver 2024-10-26 20:57:27,910 - DEBUG - VRF ids for VN ctest-vn-50179424: {'10.0.0.27': '2'} 2024-10-26 20:57:27,910 - INFO - Waiting for VM ctest-TestBasicVMVN-87107353-89441385 to be up.. 2024-10-26 20:57:28,029 - DEBUG - VM is in ACTIVE state now 2024-10-26 20:57:28,029 - INFO - VM name : ctest-TestBasicVMVN-87107353-89441385 2024-10-26 20:57:28,135 - DEBUG - VM ctest-TestBasicVMVN-87107353-89441385 ID is 94c00594-0f0d-4cc4-8294-e7d584026317 2024-10-26 20:57:28,135 - DEBUG - VM ctest-TestBasicVMVN-87107353-89441385 launched on Node cn-jenkins-deploy-platform-ansible-os-2153-1 2024-10-26 20:57:28,251 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/94c00594-0f0d-4cc4-8294-e7d584026317 2024-10-26 20:57:28,272 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/95ea06f7-82fa-4d6f-836e-c16baaa42cb2 2024-10-26 20:57:31,611 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2024-10-26 20:57:31,611 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-87107353-89441385 failed! 2024-10-26 20:57:31,675 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-87107353:ctest-vn-50179424 is 31.1.1.1 and allocation pool is NOT set 2024-10-26 20:57:31,675 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-87107353:ctest-vn-50179424 is 31.1.2.1 and allocation pool is NOT set 2024-10-26 20:57:35,748 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2024-10-26 20:57:35,749 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-87107353-89441385 failed! 2024-10-26 20:57:35,814 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-87107353:ctest-vn-50179424 is 31.1.1.1 and allocation pool is NOT set 2024-10-26 20:57:35,814 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-87107353:ctest-vn-50179424 is 31.1.2.1 and allocation pool is NOT set 2024-10-26 20:57:37,879 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.82 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.81 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.809/3.316/4.823/1.507 ms') 2024-10-26 20:57:37,879 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-87107353-89441385 passed 2024-10-26 20:57:38,046 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-26 20:57:38,047 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-87107353-89441385, IP 31.1.1.4, Port 22 2024-10-26 20:57:38,113 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-10-26 20:57:38,217 - DEBUG - VM ctest-TestBasicVMVN-87107353-89441385 is NOT ready for SSH connections, VM status: ACTIVE 2024-10-26 20:57:43,218 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-26 20:57:43,218 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-87107353-89441385, IP 31.1.1.4, Port 22 2024-10-26 20:57:43,377 - DEBUG - VM ctest-TestBasicVMVN-87107353-89441385 is ready for SSH connections 2024-10-26 20:57:43,378 - INFO - Waiting for VM ctest-TestBasicVMVN-87107353-74283350 to be up.. 2024-10-26 20:57:43,475 - DEBUG - VM is in ACTIVE state now 2024-10-26 20:57:43,476 - INFO - VM name : ctest-TestBasicVMVN-87107353-74283350 2024-10-26 20:57:43,566 - DEBUG - VM ctest-TestBasicVMVN-87107353-74283350 ID is f84b992e-2644-498f-b5ea-4c08b38c8259 2024-10-26 20:57:43,567 - DEBUG - VM ctest-TestBasicVMVN-87107353-74283350 launched on Node cn-jenkins-deploy-platform-ansible-os-2153-1 2024-10-26 20:57:43,656 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/f84b992e-2644-498f-b5ea-4c08b38c8259 2024-10-26 20:57:43,667 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/79be73da-d700-4fcc-a9f9-351a25001b25 2024-10-26 20:57:44,929 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.42 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.513 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.513/1.966/3.420/1.453 ms') 2024-10-26 20:57:44,929 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-87107353-74283350 passed 2024-10-26 20:57:45,091 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-26 20:57:45,091 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-87107353-74283350, IP 31.1.2.4, Port 22 2024-10-26 20:57:45,245 - DEBUG - VM ctest-TestBasicVMVN-87107353-74283350 is ready for SSH connections 2024-10-26 20:57:45,246 - INFO - Waiting for VM ctest-TestBasicVMVN-87107353-42976005 to be up.. 2024-10-26 20:57:45,342 - DEBUG - VM is in ACTIVE state now 2024-10-26 20:57:45,342 - INFO - VM name : ctest-TestBasicVMVN-87107353-42976005 2024-10-26 20:57:45,436 - DEBUG - VM ctest-TestBasicVMVN-87107353-42976005 ID is 947a9d2a-4ef4-41e1-a74e-33998cc4a2ae 2024-10-26 20:57:45,436 - DEBUG - VM ctest-TestBasicVMVN-87107353-42976005 launched on Node cn-jenkins-deploy-platform-ansible-os-2153-1 2024-10-26 20:57:45,529 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/947a9d2a-4ef4-41e1-a74e-33998cc4a2ae 2024-10-26 20:57:45,539 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/f9abc3af-a7f5-4450-ae1b-13168f982588 2024-10-26 20:57:46,805 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=4.42 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.531 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.531/2.475/4.420/1.944 ms') 2024-10-26 20:57:46,805 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-87107353-42976005 passed 2024-10-26 20:57:46,966 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-26 20:57:46,967 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-87107353-42976005, IP 31.1.1.3, Port 22 2024-10-26 20:57:47,125 - DEBUG - VM ctest-TestBasicVMVN-87107353-42976005 is ready for SSH connections 2024-10-26 20:57:47,125 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-26 20:57:47,126 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-10-26 20:57:47,126 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2024-10-26 20:57:50,917 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=5.167 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.264 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=1.030 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.030/2.487/5.167 ms 2024-10-26 20:57:50,917 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-87107353-89441385 passed 2024-10-26 20:57:50,917 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-26 20:57:50,917 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-10-26 20:57:50,917 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2024-10-26 20:57:54,628 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=4.229 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=1.094 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=1.164 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.094/2.162/4.229 ms 2024-10-26 20:57:54,628 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-87107353-74283350 passed 2024-10-26 20:57:54,628 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-26 20:57:54,628 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-26 20:57:54,628 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-26 20:57:54,628 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-10-26 20:57:54,628 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-10-26 20:57:54,835 - DEBUG - None 2024-10-26 20:57:54,835 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-10-26 20:57:54,835 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-10-26 20:57:55,030 - DEBUG - None 2024-10-26 20:57:55,030 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-10-26 20:57:55,031 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-10-26 20:57:55,743 - DEBUG - None 2024-10-26 20:57:55,743 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-10-26 20:57:55,744 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2024-10-26 20:57:57,980 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.222 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.819 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.579 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.106 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.430 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.430/2.031/4.819 ms 2024-10-26 20:57:57,980 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-10-26 20:57:57,980 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2024-10-26 20:58:00,275 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.859 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=5.607 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=8.044 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.500 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.956 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.842 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.434 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.434/3.034/8.044 ms 2024-10-26 20:58:00,275 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-10-26 20:58:00,276 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2024-10-26 20:58:02,603 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.471 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.963 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=6.904 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.515 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.068 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=3.088 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.505 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.505/2.787/6.904 ms 2024-10-26 20:58:02,603 - INFO - Deleting VM ctest-TestBasicVMVN-87107353-42976005 2024-10-26 20:58:02,675 - INFO - Detaching port 79be73da-d700-4fcc-a9f9-351a25001b25 from VM ctest-TestBasicVMVN-87107353-74283350 2024-10-26 20:58:02,729 - INFO - Deleting VM ctest-TestBasicVMVN-87107353-74283350 2024-10-26 20:58:02,805 - INFO - Detaching port 95ea06f7-82fa-4d6f-836e-c16baaa42cb2 from VM ctest-TestBasicVMVN-87107353-89441385 2024-10-26 20:58:02,842 - INFO - Deleting VM ctest-TestBasicVMVN-87107353-89441385 2024-10-26 20:58:02,940 - INFO - Deleting VN ctest-vn-50179424 2024-10-26 20:58:03,183 - DEBUG - Response for delete_port : () 2024-10-26 20:58:03,446 - DEBUG - Response for delete_port : () 2024-10-26 20:58:03,517 - DEBUG - VN 9f69196e-d1fa-4b5d-a382-ec2c5f538766 still in use: Unable to complete operation on network 9f69196e-d1fa-4b5d-a382-ec2c5f538766. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-eb22e7e7-1ae5-415e-a908-4bf96ccf8648'] 2024-10-26 20:58:03,518 - WARNING - Deleting VN ctest-vn-50179424 failed..Will retry 2024-10-26 20:58:05,683 - DEBUG - Response for deleting network () 2024-10-26 20:58:05,683 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e830ee28-4893-4bec-b4c3-f108ba09a503 2024-10-26 20:58:05,696 - DEBUG - Response Code: 404 2024-10-26 20:58:05,696 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-26 20:58:05,703 - DEBUG - Requesting: http://10.0.0.27:8082/domain/5665a368-f59a-40ee-918b-1fce15fa1435 2024-10-26 20:58:05,764 - DEBUG - Requesting: http://10.0.0.27:8082/project/ff93a077-fbec-41c8-ae37-22f9b453e1c9 2024-10-26 20:58:05,864 - INFO - Validated that VN ctest-vn-50179424 is not found in API Server 2024-10-26 20:58:05,883 - DEBUG - VN ctest-vn-50179424 is not present in Agent 10.0.0.27 2024-10-26 20:58:05,883 - INFO - Validated that VN ctest-vn-50179424 is not in any agent 2024-10-26 20:58:05,892 - DEBUG - VRF 2 is not seen in agent 10.0.0.27 2024-10-26 20:58:05,900 - DEBUG - Vrouter 10.0.0.27 does not have vrf 2 for VN ctest-vn-50179424 2024-10-26 20:58:05,900 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-87107353:ctest-vn-50179424 2024-10-26 20:58:05,917 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-50179424 info 2024-10-26 20:58:06,014 - INFO - IPAM: ctest-ipam-21037675 is not found in API Server 2024-10-26 20:58:06,029 - INFO - IPAM:ctest-ipam-21037675 is not found in control node 2024-10-26 20:58:06,299 - DEBUG - No XMPP flaps were noticed during the test 2024-10-26 20:58:06,299 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:44] 2024-10-26 20:58:06,299 - INFO - -------------------------------------------------------------------------------- 2024-10-26 20:58:07,080 - INFO - Deleted project: ctest-TestBasicVMVN-87107353, ID : ff93a077-fbec-41c8-ae37-22f9b453e1c9