2025-03-20 02:26:58,458 - INFO - Domain Default found not creating 2025-03-20 02:26:58,617 - INFO - Project ctest-TestBasicVMVN-62499224 not found, creating it 2025-03-20 02:26:59,082 - INFO - Created Project:ctest-TestBasicVMVN-62499224, ID : 6854ff3e-f226-4949-a6f6-7a5715956441 2025-03-20 02:27:00,676 - INFO - ================================================================================ 2025-03-20 02:27:00,676 - INFO - STARTING TEST : test_generic_link_local_service 2025-03-20 02:27:00,676 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-03-20 02:27:00,940 - DEBUG - Nothing to compare xmpp stats {'10.0.0.59': {'10.20.0.20': '0'}} with 2025-03-20 02:27:00,940 - INFO - Initial checks done. Running the testcase now 2025-03-20 02:27:00,940 - INFO - 2025-03-20 02:27:01,500 - DEBUG - Response for create_network : {'network': {'id': '7f079f04-d286-4e86-b174-f75619076f4e', 'name': 'ctest-vn2_metadata-00302194', 'tenant_id': '6854ff3ef2264949a6f67a5715956441', 'project_id': '6854ff3ef2264949a6f67a5715956441', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-62499224', 'ctest-vn2_metadata-00302194'], 'port_security_enabled': True, 'description': ''}} 2025-03-20 02:27:01,683 - DEBUG - Response for create_subnet : {'subnet': {'id': '950df07e-ff11-4de0-a04c-bb9144bfd9d4', 'name': '', 'tenant_id': '6854ff3ef2264949a6f67a5715956441', 'network_id': '7f079f04-d286-4e86-b174-f75619076f4e', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '6854ff3ef2264949a6f67a5715956441'}} 2025-03-20 02:27:01,707 - INFO - Created VN ctest-vn2_metadata-00302194 2025-03-20 02:27:01,762 - DEBUG - VN ctest-vn2_metadata-00302194 UUID is 7f079f04-d286-4e86-b174-f75619076f4e 2025-03-20 02:27:01,963 - DEBUG - Services list from nova: [, , ] 2025-03-20 02:27:02,991 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2924-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2924-1) 2025-03-20 02:27:03,097 - DEBUG - Link local service introspect added 2025-03-20 02:27:03,138 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-03-20 02:27:08,225 - DEBUG - VM is in ACTIVE state now 2025-03-20 02:27:08,357 - INFO - Waiting for VM ctest-TestBasicVMVN-62499224-82301799 to be up.. 2025-03-20 02:27:08,358 - INFO - VM name : ctest-TestBasicVMVN-62499224-82301799 2025-03-20 02:27:08,435 - DEBUG - VM ctest-TestBasicVMVN-62499224-82301799 ID is 90a85c74-18d7-4bcb-b40e-307cb7f3acce 2025-03-20 02:27:08,436 - DEBUG - VM ctest-TestBasicVMVN-62499224-82301799 launched on Node cn-jenkins-deploy-platform-ansible-os-2924-1 2025-03-20 02:27:08,526 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine/90a85c74-18d7-4bcb-b40e-307cb7f3acce 2025-03-20 02:27:08,822 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine/90a85c74-18d7-4bcb-b40e-307cb7f3acce 2025-03-20 02:27:08,854 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine-interface/cd90d3bb-0496-4c08-9f6e-0f12fd0a76f7 2025-03-20 02:27:12,121 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-03-20 02:27:12,121 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-62499224-82301799 failed! 2025-03-20 02:27:12,178 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-62499224:ctest-vn2_metadata-00302194 is 11.1.1.1 and allocation pool is NOT set 2025-03-20 02:27:14,247 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=10.2 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.65 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.645/6.401/10.158/3.756 ms') 2025-03-20 02:27:14,247 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-62499224-82301799 passed 2025-03-20 02:27:14,397 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-20 02:27:14,398 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-62499224-82301799, IP 11.1.1.3, Port 22 2025-03-20 02:27:14,453 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-03-20 02:27:14,676 - DEBUG - VM ctest-TestBasicVMVN-62499224-82301799 is NOT ready for SSH connections, VM status: ACTIVE 2025-03-20 02:27:19,677 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-20 02:27:19,677 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-62499224-82301799, IP 11.1.1.3, Port 22 2025-03-20 02:27:19,833 - DEBUG - VM ctest-TestBasicVMVN-62499224-82301799 is ready for SSH connections 2025-03-20 02:27:19,834 - INFO - Retry 0 2025-03-20 02:27:19,834 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2025-03-20 02:27:19,834 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-03-20 02:27:21,481 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-03-20 02:27:21,482 - INFO - Generic metadata worked 2025-03-20 02:27:21,729 - DEBUG - Link local service introspect removed 2025-03-20 02:27:21,730 - INFO - Deleting VM ctest-TestBasicVMVN-62499224-82301799 2025-03-20 02:27:21,803 - INFO - Deleting VN ctest-vn2_metadata-00302194 2025-03-20 02:27:21,842 - DEBUG - VN 7f079f04-d286-4e86-b174-f75619076f4e still in use: Unable to complete operation on network 7f079f04-d286-4e86-b174-f75619076f4e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-64be4c97-bf69-444d-ae98-c6474c7fc214'] 2025-03-20 02:27:21,842 - WARNING - Deleting VN ctest-vn2_metadata-00302194 failed..Will retry 2025-03-20 02:27:23,970 - DEBUG - Response for deleting network () 2025-03-20 02:27:24,223 - DEBUG - No XMPP flaps were noticed during the test 2025-03-20 02:27:24,223 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:24] 2025-03-20 02:27:24,224 - INFO - -------------------------------------------------------------------------------- 2025-03-20 02:27:24,226 - INFO - ================================================================================ 2025-03-20 02:27:24,227 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-03-20 02:27:24,227 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-03-20 02:27:24,520 - DEBUG - Nothing to compare xmpp stats {'10.0.0.59': {'10.20.0.20': '0'}} with 2025-03-20 02:27:24,520 - INFO - Initial checks done. Running the testcase now 2025-03-20 02:27:24,520 - INFO - 2025-03-20 02:27:25,009 - DEBUG - Response for create_network : {'network': {'id': '792158dc-ca94-4606-9b7d-a5e5447e5f9f', 'name': 'ctest-vn-04066984', 'tenant_id': '6854ff3ef2264949a6f67a5715956441', 'project_id': '6854ff3ef2264949a6f67a5715956441', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-62499224', 'ctest-vn-04066984'], 'port_security_enabled': True, 'description': ''}} 2025-03-20 02:27:25,187 - DEBUG - Response for create_subnet : {'subnet': {'id': '327b87df-5d0d-4717-b55d-f97a278ddf09', 'name': '', 'tenant_id': '6854ff3ef2264949a6f67a5715956441', 'network_id': '792158dc-ca94-4606-9b7d-a5e5447e5f9f', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': '6854ff3ef2264949a6f67a5715956441'}} 2025-03-20 02:27:25,377 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f8c66016-c3ec-4355-82b7-1ae9d1a217ff', 'name': '', 'tenant_id': '6854ff3ef2264949a6f67a5715956441', 'network_id': '792158dc-ca94-4606-9b7d-a5e5447e5f9f', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': '6854ff3ef2264949a6f67a5715956441'}} 2025-03-20 02:27:25,398 - INFO - Created VN ctest-vn-04066984 2025-03-20 02:27:25,449 - DEBUG - VN ctest-vn-04066984 UUID is 792158dc-ca94-4606-9b7d-a5e5447e5f9f 2025-03-20 02:27:25,823 - DEBUG - Response for create_port : {'port': {'name': '44d3d088-8f2a-4239-ae43-90fad13ffb99', 'id': '44d3d088-8f2a-4239-ae43-90fad13ffb99', 'tenant_id': '6854ff3ef2264949a6f67a5715956441', 'network_id': '792158dc-ca94-4606-9b7d-a5e5447e5f9f', 'mac_address': '02:44:d3:d0:88:8f', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '327b87df-5d0d-4717-b55d-f97a278ddf09'}], 'security_groups': ['281c9f34-30bd-4a1d-9d32-e1bf1d87fc5d'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '6854ff3ef2264949a6f67a5715956441'}} 2025-03-20 02:27:25,997 - DEBUG - Response for create_port : {'port': {'name': '865d6ba3-2de3-4374-9c5f-ea8ec83eecf0', 'id': '865d6ba3-2de3-4374-9c5f-ea8ec83eecf0', 'tenant_id': '6854ff3ef2264949a6f67a5715956441', 'network_id': '792158dc-ca94-4606-9b7d-a5e5447e5f9f', 'mac_address': '02:86:5d:6b:a3:2d', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'f8c66016-c3ec-4355-82b7-1ae9d1a217ff'}], 'security_groups': ['281c9f34-30bd-4a1d-9d32-e1bf1d87fc5d'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '6854ff3ef2264949a6f67a5715956441'}} 2025-03-20 02:27:26,435 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2924-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2924-1) 2025-03-20 02:27:26,836 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2924-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2924-1) 2025-03-20 02:27:28,026 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2924-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2924-1) 2025-03-20 02:27:28,027 - DEBUG - Requesting: http://10.0.0.59:8082/domains 2025-03-20 02:27:28,041 - DEBUG - Requesting: http://10.0.0.59:8082/domain/6f5fb79c-8fce-492c-bdfd-369cb57c7024 2025-03-20 02:27:28,063 - DEBUG - Requesting: http://10.0.0.59:8082/project/6854ff3e-f226-4949-a6f6-7a5715956441 2025-03-20 02:27:28,149 - DEBUG - Requesting: http://10.0.0.59:8082/network-ipam/a348148d-e11a-43f6-9dd0-bdd788045a90 2025-03-20 02:27:28,177 - INFO - Verifications in API Server for IPAM: ctest-ipam-50651429 passed 2025-03-20 02:27:28,188 - DEBUG - Control-node 10.0.0.59 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-62499224:ctest-ipam-50651429', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-62499224', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11765676626104959990', 'uuid-lslong': '11371797792508107408'}, 'enable': 'true', 'created': '2025-03-20T02:27:24', 'last-modified': '2025-03-20T02:27:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.427393'} 2025-03-20 02:27:28,188 - INFO - Verifications in Control node for IPAM: ctest-ipam-50651429 passed 2025-03-20 02:27:28,188 - DEBUG - Requesting: http://10.0.0.59:8082/domains 2025-03-20 02:27:28,198 - DEBUG - Requesting: http://10.0.0.59:8082/domain/6f5fb79c-8fce-492c-bdfd-369cb57c7024 2025-03-20 02:27:28,216 - DEBUG - Requesting: http://10.0.0.59:8082/project/6854ff3e-f226-4949-a6f6-7a5715956441 2025-03-20 02:27:28,293 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-network/792158dc-ca94-4606-9b7d-a5e5447e5f9f 2025-03-20 02:27:28,310 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-network/792158dc-ca94-4606-9b7d-a5e5447e5f9f 2025-03-20 02:27:28,321 - DEBUG - Requesting: http://10.0.0.59:8082/routing-instance/fa73e978-6dd6-41e7-80b5-526d6bef558e 2025-03-20 02:27:28,331 - DEBUG - Requesting: http://10.0.0.59:8082/routing-instance/fa73e978-6dd6-41e7-80b5-526d6bef558e 2025-03-20 02:27:28,340 - DEBUG - Requesting: http://10.0.0.59:8082/route-target/8eea20af-1b87-4108-80f3-7ff60a363cd4 2025-03-20 02:27:28,348 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-03-20 02:27:28,348 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-network/792158dc-ca94-4606-9b7d-a5e5447e5f9f 2025-03-20 02:27:28,359 - DEBUG - Requesting: http://10.0.0.59:8082/routing-instance/fa73e978-6dd6-41e7-80b5-526d6bef558e 2025-03-20 02:27:28,377 - INFO - Verified VN network id 8 for VN 792158dc-ca94-4606-9b7d-a5e5447e5f9f 2025-03-20 02:27:28,377 - INFO - Verifications in API Server for VN ctest-vn-04066984 passed 2025-03-20 02:27:28,377 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-network/792158dc-ca94-4606-9b7d-a5e5447e5f9f 2025-03-20 02:27:28,394 - DEBUG - Requesting: http://10.0.0.59:8082/routing-instance/fa73e978-6dd6-41e7-80b5-526d6bef558e 2025-03-20 02:27:28,407 - DEBUG - Requesting: http://10.0.0.59:8082/routing-instance/fa73e978-6dd6-41e7-80b5-526d6bef558e 2025-03-20 02:27:28,424 - DEBUG - Requesting: http://10.0.0.59:8082/route-target/8eea20af-1b87-4108-80f3-7ff60a363cd4 2025-03-20 02:27:28,444 - DEBUG - Control-node 10.0.0.59 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-62499224:ctest-vn-04066984', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-62499224', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8728355258135496198', 'uuid-lslong': '11204293852082888607'}, 'enable': 'true', 'created': '2025-03-20T02:27:24', 'last-modified': '2025-03-20T02:27:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.095585'} 2025-03-20 02:27:28,454 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-03-20 02:27:28,454 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-04066984 passed 2025-03-20 02:27:28,454 - DEBUG - ====Verifying policy data for ctest-vn-04066984 in API_Server ====== 2025-03-20 02:27:28,455 - DEBUG - Requesting: http://10.0.0.59:8082/domains 2025-03-20 02:27:28,462 - DEBUG - Requesting: http://10.0.0.59:8082/domain/6f5fb79c-8fce-492c-bdfd-369cb57c7024 2025-03-20 02:27:28,485 - DEBUG - Requesting: http://10.0.0.59:8082/project/6854ff3e-f226-4949-a6f6-7a5715956441 2025-03-20 02:27:28,585 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-network/792158dc-ca94-4606-9b7d-a5e5447e5f9f 2025-03-20 02:27:28,596 - DEBUG - =>VN ctest-vn-04066984 has no policy to be verified 2025-03-20 02:27:28,596 - DEBUG - Verifying the vn in opserver 2025-03-20 02:27:28,596 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-62499224:ctest-vn-04066984 virtual network link through opserver 10.0.0.59 2025-03-20 02:27:28,597 - DEBUG - Requesting: http://10.0.0.59:8081/analytics/uves/virtual-networks 2025-03-20 02:27:29,000 - DEBUG - Requesting: http://10.0.0.59:8081/analytics/uves/virtual-networks 2025-03-20 02:27:29,066 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-62499224:ctest-vn-04066984', 'href': 'http://10.0.0.59:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-62499224:ctest-vn-04066984?flat'} 2025-03-20 02:27:29,066 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-62499224:ctest-vn-04066984 is found in opserver 2025-03-20 02:27:29,072 - DEBUG - VRF ids for VN ctest-vn-04066984: {'10.0.0.59': '2'} 2025-03-20 02:27:29,073 - INFO - Waiting for VM ctest-TestBasicVMVN-62499224-48701942 to be up.. 2025-03-20 02:27:29,209 - DEBUG - VM is in ACTIVE state now 2025-03-20 02:27:29,209 - INFO - VM name : ctest-TestBasicVMVN-62499224-48701942 2025-03-20 02:27:29,306 - DEBUG - VM ctest-TestBasicVMVN-62499224-48701942 ID is e0d28f91-7469-4a19-93a0-9449b07bf0d8 2025-03-20 02:27:29,306 - DEBUG - VM ctest-TestBasicVMVN-62499224-48701942 launched on Node cn-jenkins-deploy-platform-ansible-os-2924-1 2025-03-20 02:27:29,398 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine/e0d28f91-7469-4a19-93a0-9449b07bf0d8 2025-03-20 02:27:29,407 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine-interface/44d3d088-8f2a-4239-ae43-90fad13ffb99 2025-03-20 02:27:32,736 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-03-20 02:27:32,736 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-62499224-48701942 failed! 2025-03-20 02:27:32,797 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-62499224:ctest-vn-04066984 is 31.1.1.1 and allocation pool is NOT set 2025-03-20 02:27:32,798 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-62499224:ctest-vn-04066984 is 31.1.2.1 and allocation pool is NOT set 2025-03-20 02:27:36,895 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1034ms') 2025-03-20 02:27:36,895 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-62499224-48701942 failed! 2025-03-20 02:27:36,950 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-62499224:ctest-vn-04066984 is 31.1.1.1 and allocation pool is NOT set 2025-03-20 02:27:36,950 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-62499224:ctest-vn-04066984 is 31.1.2.1 and allocation pool is NOT set 2025-03-20 02:27:39,017 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.96 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.07 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.073/6.016/9.959/3.943 ms') 2025-03-20 02:27:39,017 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-62499224-48701942 passed 2025-03-20 02:27:39,166 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-20 02:27:39,166 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-62499224-48701942, IP 31.1.1.4, Port 22 2025-03-20 02:27:39,325 - DEBUG - VM ctest-TestBasicVMVN-62499224-48701942 is ready for SSH connections 2025-03-20 02:27:39,326 - INFO - Waiting for VM ctest-TestBasicVMVN-62499224-52110654 to be up.. 2025-03-20 02:27:39,418 - DEBUG - VM is in ACTIVE state now 2025-03-20 02:27:39,418 - INFO - VM name : ctest-TestBasicVMVN-62499224-52110654 2025-03-20 02:27:39,502 - DEBUG - VM ctest-TestBasicVMVN-62499224-52110654 ID is fca637e9-33ab-44a0-b050-ff8d81837535 2025-03-20 02:27:39,502 - DEBUG - VM ctest-TestBasicVMVN-62499224-52110654 launched on Node cn-jenkins-deploy-platform-ansible-os-2924-1 2025-03-20 02:27:39,590 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine/fca637e9-33ab-44a0-b050-ff8d81837535 2025-03-20 02:27:39,601 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine-interface/865d6ba3-2de3-4374-9c5f-ea8ec83eecf0 2025-03-20 02:27:40,851 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.13 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.17 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.167/3.149/4.131/0.982 ms') 2025-03-20 02:27:40,851 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-62499224-52110654 passed 2025-03-20 02:27:41,002 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-20 02:27:41,002 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-62499224-52110654, IP 31.1.2.4, Port 22 2025-03-20 02:27:41,157 - DEBUG - VM ctest-TestBasicVMVN-62499224-52110654 is ready for SSH connections 2025-03-20 02:27:41,157 - INFO - Waiting for VM ctest-TestBasicVMVN-62499224-57095179 to be up.. 2025-03-20 02:27:41,236 - DEBUG - VM is in ACTIVE state now 2025-03-20 02:27:41,236 - INFO - VM name : ctest-TestBasicVMVN-62499224-57095179 2025-03-20 02:27:41,316 - DEBUG - VM ctest-TestBasicVMVN-62499224-57095179 ID is 69eb1684-a833-4eff-914d-8246b0923a72 2025-03-20 02:27:41,317 - DEBUG - VM ctest-TestBasicVMVN-62499224-57095179 launched on Node cn-jenkins-deploy-platform-ansible-os-2924-1 2025-03-20 02:27:41,391 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine/69eb1684-a833-4eff-914d-8246b0923a72 2025-03-20 02:27:41,399 - DEBUG - Requesting: http://10.0.0.59:8082/virtual-machine-interface/a0297901-41db-4eb4-b045-3f921af792f7 2025-03-20 02:27:42,641 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.39 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.672 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.672/2.033/3.394/1.361 ms') 2025-03-20 02:27:42,641 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-62499224-57095179 passed 2025-03-20 02:27:42,790 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-20 02:27:42,790 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-62499224-57095179, IP 31.1.1.3, Port 22 2025-03-20 02:27:42,945 - DEBUG - VM ctest-TestBasicVMVN-62499224-57095179 is ready for SSH connections 2025-03-20 02:27:42,945 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-20 02:27:42,945 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2025-03-20 02:27:42,945 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2025-03-20 02:27:46,683 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.760 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.817 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=0.839 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.817/2.138/4.760 ms 2025-03-20 02:27:46,683 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-62499224-48701942 passed 2025-03-20 02:27:46,684 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-20 02:27:46,684 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2025-03-20 02:27:46,684 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2025-03-20 02:27:50,380 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=3.175 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.938 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=0.940 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.938/1.684/3.175 ms 2025-03-20 02:27:50,380 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-62499224-52110654 passed 2025-03-20 02:27:50,380 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-20 02:27:50,380 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-20 02:27:50,380 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-20 02:27:50,380 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2025-03-20 02:27:50,381 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-03-20 02:27:50,600 - DEBUG - None 2025-03-20 02:27:50,600 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2025-03-20 02:27:50,600 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-03-20 02:27:50,790 - DEBUG - None 2025-03-20 02:27:50,790 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2025-03-20 02:27:50,790 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-03-20 02:27:51,423 - DEBUG - None 2025-03-20 02:27:51,424 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2025-03-20 02:27:51,424 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2025-03-20 02:27:53,657 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.844 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=5.965 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.437 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.618 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.435 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.435/2.259/5.965 ms 2025-03-20 02:27:53,658 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2025-03-20 02:27:53,658 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2025-03-20 02:27:55,912 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.020 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.975 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=5.117 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.720 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.319 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=3.374 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.451 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.451/2.425/5.117 ms 2025-03-20 02:27:55,912 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.59, gateway password: c0ntrail123 2025-03-20 02:27:55,912 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2025-03-20 02:27:58,163 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.631 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=2.377 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.151 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.439 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.918 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.858 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.339 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.339/1.673/3.151 ms 2025-03-20 02:27:58,164 - INFO - Deleting VM ctest-TestBasicVMVN-62499224-57095179 2025-03-20 02:27:58,240 - INFO - Detaching port 865d6ba3-2de3-4374-9c5f-ea8ec83eecf0 from VM ctest-TestBasicVMVN-62499224-52110654 2025-03-20 02:27:58,294 - INFO - Deleting VM ctest-TestBasicVMVN-62499224-52110654 2025-03-20 02:27:58,361 - INFO - Detaching port 44d3d088-8f2a-4239-ae43-90fad13ffb99 from VM ctest-TestBasicVMVN-62499224-48701942 2025-03-20 02:27:58,396 - INFO - Deleting VM ctest-TestBasicVMVN-62499224-48701942 2025-03-20 02:27:58,482 - INFO - Deleting VN ctest-vn-04066984 2025-03-20 02:27:58,663 - DEBUG - Response for delete_port : () 2025-03-20 02:27:58,859 - DEBUG - Response for delete_port : () 2025-03-20 02:27:58,922 - DEBUG - VN 792158dc-ca94-4606-9b7d-a5e5447e5f9f still in use: Unable to complete operation on network 792158dc-ca94-4606-9b7d-a5e5447e5f9f. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a3f87ca4-71da-403f-8d4b-89544b992c6a'] 2025-03-20 02:27:58,922 - WARNING - Deleting VN ctest-vn-04066984 failed..Will retry 2025-03-20 02:28:01,091 - DEBUG - Response for deleting network () 2025-03-20 02:28:01,091 - DEBUG - Requesting: http://10.0.0.59:8082/routing-instance/fa73e978-6dd6-41e7-80b5-526d6bef558e 2025-03-20 02:28:01,100 - DEBUG - Response Code: 404 2025-03-20 02:28:01,100 - DEBUG - Requesting: http://10.0.0.59:8082/domains 2025-03-20 02:28:01,107 - DEBUG - Requesting: http://10.0.0.59:8082/domain/6f5fb79c-8fce-492c-bdfd-369cb57c7024 2025-03-20 02:28:01,165 - DEBUG - Requesting: http://10.0.0.59:8082/project/6854ff3e-f226-4949-a6f6-7a5715956441 2025-03-20 02:28:01,233 - INFO - Validated that VN ctest-vn-04066984 is not found in API Server 2025-03-20 02:28:01,244 - DEBUG - VN ctest-vn-04066984 is not present in Agent 10.0.0.59 2025-03-20 02:28:01,244 - INFO - Validated that VN ctest-vn-04066984 is not in any agent 2025-03-20 02:28:01,251 - DEBUG - VRF 2 is not seen in agent 10.0.0.59 2025-03-20 02:28:01,259 - DEBUG - Vrouter 10.0.0.59 does not have vrf 2 for VN ctest-vn-04066984 2025-03-20 02:28:01,259 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-62499224:ctest-vn-04066984 2025-03-20 02:28:01,271 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-04066984 info 2025-03-20 02:28:01,357 - INFO - IPAM: ctest-ipam-50651429 is not found in API Server 2025-03-20 02:28:01,370 - INFO - IPAM:ctest-ipam-50651429 is not found in control node 2025-03-20 02:28:01,636 - DEBUG - No XMPP flaps were noticed during the test 2025-03-20 02:28:01,636 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:37] 2025-03-20 02:28:01,636 - INFO - -------------------------------------------------------------------------------- 2025-03-20 02:28:02,367 - INFO - Deleted project: ctest-TestBasicVMVN-62499224, ID : 6854ff3e-f226-4949-a6f6-7a5715956441