2025-01-02 23:29:59,836 - INFO - Domain Default found not creating 2025-01-02 23:29:59,985 - INFO - Project ctest-TestBasicVMVN-07547463 not found, creating it 2025-01-02 23:30:00,460 - INFO - Created Project:ctest-TestBasicVMVN-07547463, ID : 01372e3b-408d-43df-8925-978be83fd5b6 2025-01-02 23:30:02,019 - INFO - ================================================================================ 2025-01-02 23:30:02,019 - INFO - STARTING TEST : test_generic_link_local_service 2025-01-02 23:30:02,019 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-01-02 23:30:02,276 - DEBUG - Nothing to compare xmpp stats {'10.0.0.17': {'10.20.0.5': '0'}} with 2025-01-02 23:30:02,276 - INFO - Initial checks done. Running the testcase now 2025-01-02 23:30:02,276 - INFO - 2025-01-02 23:30:03,109 - DEBUG - Response for create_network : {'network': {'id': '70071220-29bc-4f0b-ad18-f13f345f7402', 'name': 'ctest-vn2_metadata-15746277', 'tenant_id': '01372e3b408d43df8925978be83fd5b6', 'project_id': '01372e3b408d43df8925978be83fd5b6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-07547463', 'ctest-vn2_metadata-15746277'], 'port_security_enabled': True, 'description': ''}} 2025-01-02 23:30:03,335 - DEBUG - Response for create_subnet : {'subnet': {'id': '54ec1e5e-88a6-440a-b468-942d0cb3271b', 'name': '', 'tenant_id': '01372e3b408d43df8925978be83fd5b6', 'network_id': '70071220-29bc-4f0b-ad18-f13f345f7402', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '01372e3b408d43df8925978be83fd5b6'}} 2025-01-02 23:30:03,353 - INFO - Created VN ctest-vn2_metadata-15746277 2025-01-02 23:30:03,410 - DEBUG - VN ctest-vn2_metadata-15746277 UUID is 70071220-29bc-4f0b-ad18-f13f345f7402 2025-01-02 23:30:03,588 - DEBUG - Services list from nova: [, , ] 2025-01-02 23:30:04,606 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2517-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2517-1) 2025-01-02 23:30:04,718 - DEBUG - Link local service introspect added 2025-01-02 23:30:04,759 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-01-02 23:30:09,952 - DEBUG - VM is in ACTIVE state now 2025-01-02 23:30:10,082 - INFO - Waiting for VM ctest-TestBasicVMVN-07547463-30048295 to be up.. 2025-01-02 23:30:10,082 - INFO - VM name : ctest-TestBasicVMVN-07547463-30048295 2025-01-02 23:30:10,163 - DEBUG - VM ctest-TestBasicVMVN-07547463-30048295 ID is 999d62aa-010e-43fc-8cc3-57d90965c912 2025-01-02 23:30:10,163 - DEBUG - VM ctest-TestBasicVMVN-07547463-30048295 launched on Node cn-jenkins-deploy-platform-ansible-os-2517-1 2025-01-02 23:30:10,242 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-machine/999d62aa-010e-43fc-8cc3-57d90965c912 2025-01-02 23:30:10,535 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-machine/999d62aa-010e-43fc-8cc3-57d90965c912 2025-01-02 23:30:10,565 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-machine-interface/e6a8f19a-e193-4969-b5cb-03a0216fbf72 2025-01-02 23:30:13,826 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-01-02 23:30:13,826 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-07547463-30048295 failed! 2025-01-02 23:30:13,882 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-07547463:ctest-vn2_metadata-15746277 is 11.1.1.1 and allocation pool is NOT set 2025-01-02 23:30:15,948 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.38 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.62 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 1.621/3.002/4.384/1.381 ms') 2025-01-02 23:30:15,948 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-07547463-30048295 passed 2025-01-02 23:30:16,098 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 23:30:16,098 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-07547463-30048295, IP 11.1.1.3, Port 22 2025-01-02 23:30:16,154 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-01-02 23:30:16,231 - DEBUG - VM ctest-TestBasicVMVN-07547463-30048295 is NOT ready for SSH connections, VM status: ACTIVE 2025-01-02 23:30:21,231 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 23:30:21,232 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-07547463-30048295, IP 11.1.1.3, Port 22 2025-01-02 23:30:21,397 - DEBUG - VM ctest-TestBasicVMVN-07547463-30048295 is ready for SSH connections 2025-01-02 23:30:21,398 - INFO - Retry 0 2025-01-02 23:30:21,398 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.17, gateway password: c0ntrail123 2025-01-02 23:30:21,398 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-01-02 23:30:23,307 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-01-02 23:30:23,307 - INFO - Generic metadata worked 2025-01-02 23:30:23,562 - DEBUG - Link local service introspect removed 2025-01-02 23:30:23,562 - INFO - Deleting VM ctest-TestBasicVMVN-07547463-30048295 2025-01-02 23:30:23,626 - INFO - Deleting VN ctest-vn2_metadata-15746277 2025-01-02 23:30:23,660 - DEBUG - VN 70071220-29bc-4f0b-ad18-f13f345f7402 still in use: Unable to complete operation on network 70071220-29bc-4f0b-ad18-f13f345f7402. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-55543a84-8f00-4f66-9978-8012a5b66633'] 2025-01-02 23:30:23,661 - WARNING - Deleting VN ctest-vn2_metadata-15746277 failed..Will retry 2025-01-02 23:30:25,794 - DEBUG - Response for deleting network () 2025-01-02 23:30:26,056 - DEBUG - No XMPP flaps were noticed during the test 2025-01-02 23:30:26,056 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:24] 2025-01-02 23:30:26,056 - INFO - -------------------------------------------------------------------------------- 2025-01-02 23:30:26,059 - INFO - ================================================================================ 2025-01-02 23:30:26,059 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-01-02 23:30:26,059 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-01-02 23:30:26,348 - DEBUG - Nothing to compare xmpp stats {'10.0.0.17': {'10.20.0.5': '0'}} with 2025-01-02 23:30:26,348 - INFO - Initial checks done. Running the testcase now 2025-01-02 23:30:26,348 - INFO - 2025-01-02 23:30:26,825 - DEBUG - Response for create_network : {'network': {'id': '759182d3-6b85-4020-8e14-dc5be02daf5f', 'name': 'ctest-vn-99630725', 'tenant_id': '01372e3b408d43df8925978be83fd5b6', 'project_id': '01372e3b408d43df8925978be83fd5b6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-07547463', 'ctest-vn-99630725'], 'port_security_enabled': True, 'description': ''}} 2025-01-02 23:30:27,023 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e28d3f52-d5b3-4809-be78-ba57088cb175', 'name': '', 'tenant_id': '01372e3b408d43df8925978be83fd5b6', 'network_id': '759182d3-6b85-4020-8e14-dc5be02daf5f', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': '01372e3b408d43df8925978be83fd5b6'}} 2025-01-02 23:30:27,193 - DEBUG - Response for create_subnet : {'subnet': {'id': '324b7c0c-2a6a-4abb-bc56-0204b90795d9', 'name': '', 'tenant_id': '01372e3b408d43df8925978be83fd5b6', 'network_id': '759182d3-6b85-4020-8e14-dc5be02daf5f', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': '01372e3b408d43df8925978be83fd5b6'}} 2025-01-02 23:30:27,216 - INFO - Created VN ctest-vn-99630725 2025-01-02 23:30:27,270 - DEBUG - VN ctest-vn-99630725 UUID is 759182d3-6b85-4020-8e14-dc5be02daf5f 2025-01-02 23:30:27,648 - DEBUG - Response for create_port : {'port': {'name': '12b35b39-dd47-449c-a177-911874bc6e06', 'id': '12b35b39-dd47-449c-a177-911874bc6e06', 'tenant_id': '01372e3b408d43df8925978be83fd5b6', 'network_id': '759182d3-6b85-4020-8e14-dc5be02daf5f', 'mac_address': '02:12:b3:5b:39:dd', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': 'e28d3f52-d5b3-4809-be78-ba57088cb175'}], 'security_groups': ['21cdf53d-73f8-47d5-ab66-ab3cb3c75220'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '01372e3b408d43df8925978be83fd5b6'}} 2025-01-02 23:30:27,829 - DEBUG - Response for create_port : {'port': {'name': 'e8891fa8-4388-4ad2-9c6d-5ea7a8805ab3', 'id': 'e8891fa8-4388-4ad2-9c6d-5ea7a8805ab3', 'tenant_id': '01372e3b408d43df8925978be83fd5b6', 'network_id': '759182d3-6b85-4020-8e14-dc5be02daf5f', 'mac_address': '02:e8:89:1f:a8:43', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': '324b7c0c-2a6a-4abb-bc56-0204b90795d9'}], 'security_groups': ['21cdf53d-73f8-47d5-ab66-ab3cb3c75220'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '01372e3b408d43df8925978be83fd5b6'}} 2025-01-02 23:30:28,234 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2517-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2517-1) 2025-01-02 23:30:28,644 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2517-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2517-1) 2025-01-02 23:30:29,804 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2517-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2517-1) 2025-01-02 23:30:29,805 - DEBUG - Requesting: http://10.0.0.17:8082/domains 2025-01-02 23:30:29,813 - DEBUG - Requesting: http://10.0.0.17:8082/domain/2b4552d9-1325-4362-9533-6f1f67cc86dc 2025-01-02 23:30:29,827 - DEBUG - Requesting: http://10.0.0.17:8082/project/01372e3b-408d-43df-8925-978be83fd5b6 2025-01-02 23:30:29,912 - DEBUG - Requesting: http://10.0.0.17:8082/network-ipam/0e45d035-4248-4239-bc52-156684476ce2 2025-01-02 23:30:29,921 - INFO - Verifications in API Server for IPAM: ctest-ipam-84745456 passed 2025-01-02 23:30:29,927 - DEBUG - Control-node 10.0.0.17 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-07547463:ctest-ipam-84745456', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-07547463', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1028457017087902265', 'uuid-lslong': '13569932157270846690'}, 'enable': 'true', 'created': '2025-01-02T23:30:26', 'last-modified': '2025-01-02T23:30:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.345491'} 2025-01-02 23:30:29,927 - INFO - Verifications in Control node for IPAM: ctest-ipam-84745456 passed 2025-01-02 23:30:29,928 - DEBUG - Requesting: http://10.0.0.17:8082/domains 2025-01-02 23:30:29,933 - DEBUG - Requesting: http://10.0.0.17:8082/domain/2b4552d9-1325-4362-9533-6f1f67cc86dc 2025-01-02 23:30:29,945 - DEBUG - Requesting: http://10.0.0.17:8082/project/01372e3b-408d-43df-8925-978be83fd5b6 2025-01-02 23:30:30,021 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-network/759182d3-6b85-4020-8e14-dc5be02daf5f 2025-01-02 23:30:30,032 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-network/759182d3-6b85-4020-8e14-dc5be02daf5f 2025-01-02 23:30:30,044 - DEBUG - Requesting: http://10.0.0.17:8082/routing-instance/ed9b628f-0b32-41b0-bdbc-695b75e6c17d 2025-01-02 23:30:30,052 - DEBUG - Requesting: http://10.0.0.17:8082/routing-instance/ed9b628f-0b32-41b0-bdbc-695b75e6c17d 2025-01-02 23:30:30,060 - DEBUG - Requesting: http://10.0.0.17:8082/route-target/cd9865da-8799-479c-a157-7596643a413b 2025-01-02 23:30:30,067 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-01-02 23:30:30,067 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-network/759182d3-6b85-4020-8e14-dc5be02daf5f 2025-01-02 23:30:30,079 - DEBUG - Requesting: http://10.0.0.17:8082/routing-instance/ed9b628f-0b32-41b0-bdbc-695b75e6c17d 2025-01-02 23:30:30,093 - INFO - Verified VN network id 9 for VN 759182d3-6b85-4020-8e14-dc5be02daf5f 2025-01-02 23:30:30,093 - INFO - Verifications in API Server for VN ctest-vn-99630725 passed 2025-01-02 23:30:30,093 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-network/759182d3-6b85-4020-8e14-dc5be02daf5f 2025-01-02 23:30:30,103 - DEBUG - Requesting: http://10.0.0.17:8082/routing-instance/ed9b628f-0b32-41b0-bdbc-695b75e6c17d 2025-01-02 23:30:30,110 - DEBUG - Requesting: http://10.0.0.17:8082/routing-instance/ed9b628f-0b32-41b0-bdbc-695b75e6c17d 2025-01-02 23:30:30,117 - DEBUG - Requesting: http://10.0.0.17:8082/route-target/cd9865da-8799-479c-a157-7596643a413b 2025-01-02 23:30:30,131 - DEBUG - Control-node 10.0.0.17 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-07547463:ctest-vn-99630725', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-07547463', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8471696218614218784', 'uuid-lslong': '10238050140081205087'}, 'enable': 'true', 'created': '2025-01-02T23:30:26', 'last-modified': '2025-01-02T23:30:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.971170'} 2025-01-02 23:30:30,138 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-01-02 23:30:30,138 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-99630725 passed 2025-01-02 23:30:30,138 - DEBUG - ====Verifying policy data for ctest-vn-99630725 in API_Server ====== 2025-01-02 23:30:30,138 - DEBUG - Requesting: http://10.0.0.17:8082/domains 2025-01-02 23:30:30,145 - DEBUG - Requesting: http://10.0.0.17:8082/domain/2b4552d9-1325-4362-9533-6f1f67cc86dc 2025-01-02 23:30:30,157 - DEBUG - Requesting: http://10.0.0.17:8082/project/01372e3b-408d-43df-8925-978be83fd5b6 2025-01-02 23:30:30,248 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-network/759182d3-6b85-4020-8e14-dc5be02daf5f 2025-01-02 23:30:30,258 - DEBUG - =>VN ctest-vn-99630725 has no policy to be verified 2025-01-02 23:30:30,258 - DEBUG - Verifying the vn in opserver 2025-01-02 23:30:30,258 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-07547463:ctest-vn-99630725 virtual network link through opserver 10.0.0.17 2025-01-02 23:30:30,259 - DEBUG - Requesting: http://10.0.0.17:8081/analytics/uves/virtual-networks 2025-01-02 23:30:30,587 - DEBUG - Requesting: http://10.0.0.17:8081/analytics/uves/virtual-networks 2025-01-02 23:30:30,696 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-07547463:ctest-vn-99630725', 'href': 'http://10.0.0.17:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-07547463:ctest-vn-99630725?flat'} 2025-01-02 23:30:30,696 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-07547463:ctest-vn-99630725 is found in opserver 2025-01-02 23:30:30,707 - DEBUG - VRF ids for VN ctest-vn-99630725: {'10.0.0.17': '2'} 2025-01-02 23:30:30,707 - INFO - Waiting for VM ctest-TestBasicVMVN-07547463-91297439 to be up.. 2025-01-02 23:30:30,895 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-01-02 23:30:35,983 - DEBUG - VM is in ACTIVE state now 2025-01-02 23:30:35,984 - INFO - VM name : ctest-TestBasicVMVN-07547463-91297439 2025-01-02 23:30:36,060 - DEBUG - VM ctest-TestBasicVMVN-07547463-91297439 ID is 97c93910-63e6-43e6-b5a3-91608e23fb7b 2025-01-02 23:30:36,061 - DEBUG - VM ctest-TestBasicVMVN-07547463-91297439 launched on Node cn-jenkins-deploy-platform-ansible-os-2517-1 2025-01-02 23:30:36,148 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-machine/97c93910-63e6-43e6-b5a3-91608e23fb7b 2025-01-02 23:30:36,158 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-machine-interface/12b35b39-dd47-449c-a177-911874bc6e06 2025-01-02 23:30:39,431 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2025-01-02 23:30:39,431 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-07547463-91297439 failed! 2025-01-02 23:30:39,486 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-07547463:ctest-vn-99630725 is 31.1.1.1 and allocation pool is NOT set 2025-01-02 23:30:39,486 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-07547463:ctest-vn-99630725 is 31.1.2.1 and allocation pool is NOT set 2025-01-02 23:30:41,546 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.91 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.843 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.843/2.376/3.910/1.533 ms') 2025-01-02 23:30:41,546 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-07547463-91297439 passed 2025-01-02 23:30:41,698 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 23:30:41,698 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-07547463-91297439, IP 31.1.1.4, Port 22 2025-01-02 23:30:41,854 - DEBUG - VM ctest-TestBasicVMVN-07547463-91297439 is ready for SSH connections 2025-01-02 23:30:41,854 - INFO - Waiting for VM ctest-TestBasicVMVN-07547463-28607575 to be up.. 2025-01-02 23:30:41,929 - DEBUG - VM is in ACTIVE state now 2025-01-02 23:30:41,929 - INFO - VM name : ctest-TestBasicVMVN-07547463-28607575 2025-01-02 23:30:42,001 - DEBUG - VM ctest-TestBasicVMVN-07547463-28607575 ID is a2bc56e2-a5e3-4daf-94e3-0620a1522818 2025-01-02 23:30:42,002 - DEBUG - VM ctest-TestBasicVMVN-07547463-28607575 launched on Node cn-jenkins-deploy-platform-ansible-os-2517-1 2025-01-02 23:30:42,074 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-machine/a2bc56e2-a5e3-4daf-94e3-0620a1522818 2025-01-02 23:30:42,083 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-machine-interface/e8891fa8-4388-4ad2-9c6d-5ea7a8805ab3 2025-01-02 23:30:43,327 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.78 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.416 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.416/1.598/2.781/1.182 ms') 2025-01-02 23:30:43,327 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-07547463-28607575 passed 2025-01-02 23:30:43,482 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 23:30:43,482 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-07547463-28607575, IP 31.1.2.4, Port 22 2025-01-02 23:30:43,646 - DEBUG - VM ctest-TestBasicVMVN-07547463-28607575 is ready for SSH connections 2025-01-02 23:30:43,646 - INFO - Waiting for VM ctest-TestBasicVMVN-07547463-83343918 to be up.. 2025-01-02 23:30:43,738 - DEBUG - VM is in ACTIVE state now 2025-01-02 23:30:43,738 - INFO - VM name : ctest-TestBasicVMVN-07547463-83343918 2025-01-02 23:30:43,816 - DEBUG - VM ctest-TestBasicVMVN-07547463-83343918 ID is 9e5c6d02-0c66-410d-a759-1996a86cb3a1 2025-01-02 23:30:43,816 - DEBUG - VM ctest-TestBasicVMVN-07547463-83343918 launched on Node cn-jenkins-deploy-platform-ansible-os-2517-1 2025-01-02 23:30:43,893 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-machine/9e5c6d02-0c66-410d-a759-1996a86cb3a1 2025-01-02 23:30:43,904 - DEBUG - Requesting: http://10.0.0.17:8082/virtual-machine-interface/11757a7f-8fd9-41e9-91fc-efc3a7e4d0ad 2025-01-02 23:30:45,139 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=2.72 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.456 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.456/1.587/2.719/1.131 ms') 2025-01-02 23:30:45,139 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-07547463-83343918 passed 2025-01-02 23:30:45,290 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 23:30:45,291 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-07547463-83343918, IP 31.1.1.3, Port 22 2025-01-02 23:30:45,441 - DEBUG - VM ctest-TestBasicVMVN-07547463-83343918 is ready for SSH connections 2025-01-02 23:30:45,442 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 23:30:45,442 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.17, gateway password: c0ntrail123 2025-01-02 23:30:45,442 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2025-01-02 23:30:49,137 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.985 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.966 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=0.971 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.966/1.974/3.985 ms 2025-01-02 23:30:49,137 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-07547463-91297439 passed 2025-01-02 23:30:49,137 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 23:30:49,137 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.17, gateway password: c0ntrail123 2025-01-02 23:30:49,137 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2025-01-02 23:30:52,787 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=3.198 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.999 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=0.963 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.963/1.720/3.198 ms 2025-01-02 23:30:52,788 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-07547463-28607575 passed 2025-01-02 23:30:52,788 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 23:30:52,788 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 23:30:52,788 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 23:30:52,788 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.17, gateway password: c0ntrail123 2025-01-02 23:30:52,788 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-01-02 23:30:52,965 - DEBUG - None 2025-01-02 23:30:52,965 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.17, gateway password: c0ntrail123 2025-01-02 23:30:52,966 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-01-02 23:30:53,148 - DEBUG - None 2025-01-02 23:30:53,149 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.17, gateway password: c0ntrail123 2025-01-02 23:30:53,149 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-01-02 23:30:53,758 - DEBUG - None 2025-01-02 23:30:53,759 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.17, gateway password: c0ntrail123 2025-01-02 23:30:53,759 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2025-01-02 23:30:55,987 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.889 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.391 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.516 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.691 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.350 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.350/1.767/4.391 ms 2025-01-02 23:30:55,987 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.17, gateway password: c0ntrail123 2025-01-02 23:30:55,987 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2025-01-02 23:30:58,220 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.952 ms 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.722 ms (DUP!) 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.889 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.502 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.300 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=3.159 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.381 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.381/2.272/4.889 ms 2025-01-02 23:30:58,220 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.17, gateway password: c0ntrail123 2025-01-02 23:30:58,220 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2025-01-02 23:31:00,469 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.762 ms 64 bytes from 31.1.2.4: seq=0 ttl=63 time=2.468 ms (DUP!) 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.246 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.415 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.283 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=3.247 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.362 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.362/1.826/3.247 ms 2025-01-02 23:31:00,469 - INFO - Deleting VM ctest-TestBasicVMVN-07547463-83343918 2025-01-02 23:31:00,536 - INFO - Detaching port e8891fa8-4388-4ad2-9c6d-5ea7a8805ab3 from VM ctest-TestBasicVMVN-07547463-28607575 2025-01-02 23:31:00,589 - INFO - Deleting VM ctest-TestBasicVMVN-07547463-28607575 2025-01-02 23:31:00,663 - INFO - Detaching port 12b35b39-dd47-449c-a177-911874bc6e06 from VM ctest-TestBasicVMVN-07547463-91297439 2025-01-02 23:31:00,704 - INFO - Deleting VM ctest-TestBasicVMVN-07547463-91297439 2025-01-02 23:31:00,788 - INFO - Deleting VN ctest-vn-99630725 2025-01-02 23:31:00,942 - DEBUG - Response for delete_port : () 2025-01-02 23:31:01,111 - DEBUG - Response for delete_port : () 2025-01-02 23:31:01,161 - DEBUG - VN 759182d3-6b85-4020-8e14-dc5be02daf5f still in use: Unable to complete operation on network 759182d3-6b85-4020-8e14-dc5be02daf5f. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-8d3981b6-5f47-4b52-9df4-2d3ab34d666c'] 2025-01-02 23:31:01,162 - WARNING - Deleting VN ctest-vn-99630725 failed..Will retry 2025-01-02 23:31:03,282 - DEBUG - Response for deleting network () 2025-01-02 23:31:03,282 - DEBUG - Requesting: http://10.0.0.17:8082/routing-instance/ed9b628f-0b32-41b0-bdbc-695b75e6c17d 2025-01-02 23:31:03,289 - DEBUG - Response Code: 404 2025-01-02 23:31:03,289 - DEBUG - Requesting: http://10.0.0.17:8082/domains 2025-01-02 23:31:03,294 - DEBUG - Requesting: http://10.0.0.17:8082/domain/2b4552d9-1325-4362-9533-6f1f67cc86dc 2025-01-02 23:31:03,348 - DEBUG - Requesting: http://10.0.0.17:8082/project/01372e3b-408d-43df-8925-978be83fd5b6 2025-01-02 23:31:03,422 - INFO - Validated that VN ctest-vn-99630725 is not found in API Server 2025-01-02 23:31:03,433 - DEBUG - VN ctest-vn-99630725 is not present in Agent 10.0.0.17 2025-01-02 23:31:03,433 - INFO - Validated that VN ctest-vn-99630725 is not in any agent 2025-01-02 23:31:03,438 - DEBUG - VRF 2 is not seen in agent 10.0.0.17 2025-01-02 23:31:03,443 - DEBUG - Vrouter 10.0.0.17 does not have vrf 2 for VN ctest-vn-99630725 2025-01-02 23:31:03,443 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-07547463:ctest-vn-99630725 2025-01-02 23:31:03,453 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-99630725 info 2025-01-02 23:31:03,534 - INFO - IPAM: ctest-ipam-84745456 is not found in API Server 2025-01-02 23:31:03,544 - INFO - IPAM:ctest-ipam-84745456 is not found in control node 2025-01-02 23:31:03,803 - DEBUG - No XMPP flaps were noticed during the test 2025-01-02 23:31:03,803 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:37] 2025-01-02 23:31:03,803 - INFO - -------------------------------------------------------------------------------- 2025-01-02 23:31:04,500 - INFO - Deleted project: ctest-TestBasicVMVN-07547463, ID : 01372e3b-408d-43df-8925-978be83fd5b6