2025-03-10 02:26:47,073 - INFO - Domain Default found not creating 2025-03-10 02:26:47,210 - INFO - Project ctest-TestBasicVMVN-65836183 not found, creating it 2025-03-10 02:26:47,647 - INFO - Created Project:ctest-TestBasicVMVN-65836183, ID : 28ec74cd-fb8c-4191-a578-f1506b4c9b83 2025-03-10 02:26:49,115 - INFO - ================================================================================ 2025-03-10 02:26:49,116 - INFO - STARTING TEST : test_generic_link_local_service 2025-03-10 02:26:49,116 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-03-10 02:26:49,369 - DEBUG - Nothing to compare xmpp stats {'10.0.0.60': {'10.20.0.14': '0'}} with 2025-03-10 02:26:49,369 - INFO - Initial checks done. Running the testcase now 2025-03-10 02:26:49,369 - INFO - 2025-03-10 02:26:49,887 - DEBUG - Response for create_network : {'network': {'id': '3d37c187-73ef-4d54-94ba-f6362c66f230', 'name': 'ctest-vn2_metadata-11532966', 'tenant_id': '28ec74cdfb8c4191a578f1506b4c9b83', 'project_id': '28ec74cdfb8c4191a578f1506b4c9b83', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-65836183', 'ctest-vn2_metadata-11532966'], 'port_security_enabled': True, 'description': ''}} 2025-03-10 02:26:50,069 - DEBUG - Response for create_subnet : {'subnet': {'id': '5f6d8cff-b770-4dd8-baf2-36bed2b4ce98', 'name': '', 'tenant_id': '28ec74cdfb8c4191a578f1506b4c9b83', 'network_id': '3d37c187-73ef-4d54-94ba-f6362c66f230', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '28ec74cdfb8c4191a578f1506b4c9b83'}} 2025-03-10 02:26:50,085 - INFO - Created VN ctest-vn2_metadata-11532966 2025-03-10 02:26:50,135 - DEBUG - VN ctest-vn2_metadata-11532966 UUID is 3d37c187-73ef-4d54-94ba-f6362c66f230 2025-03-10 02:26:50,310 - DEBUG - Services list from nova: [, , ] 2025-03-10 02:26:51,364 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2827-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2827-1) 2025-03-10 02:26:51,470 - DEBUG - Link local service introspect added 2025-03-10 02:26:51,524 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-03-10 02:26:56,597 - DEBUG - VM is in ACTIVE state now 2025-03-10 02:26:56,722 - INFO - Waiting for VM ctest-TestBasicVMVN-65836183-71761824 to be up.. 2025-03-10 02:26:56,722 - INFO - VM name : ctest-TestBasicVMVN-65836183-71761824 2025-03-10 02:26:56,795 - DEBUG - VM ctest-TestBasicVMVN-65836183-71761824 ID is 66a9c241-38e3-46ce-b382-468e54d6cf1a 2025-03-10 02:26:56,795 - DEBUG - VM ctest-TestBasicVMVN-65836183-71761824 launched on Node cn-jenkins-deploy-platform-ansible-os-2827-1 2025-03-10 02:26:56,865 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-machine/66a9c241-38e3-46ce-b382-468e54d6cf1a 2025-03-10 02:26:57,161 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-machine/66a9c241-38e3-46ce-b382-468e54d6cf1a 2025-03-10 02:26:57,190 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-machine-interface/8805e693-50e1-4ce3-a36e-6f19006c9aec 2025-03-10 02:27:00,452 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-03-10 02:27:00,452 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-65836183-71761824 failed! 2025-03-10 02:27:00,507 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-65836183:ctest-vn2_metadata-11532966 is 11.1.1.1 and allocation pool is NOT set 2025-03-10 02:27:02,571 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.14 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.28 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.282/2.709/4.137/1.427 ms') 2025-03-10 02:27:02,572 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-65836183-71761824 passed 2025-03-10 02:27:02,723 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-10 02:27:02,723 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-65836183-71761824, IP 11.1.1.3, Port 22 2025-03-10 02:27:02,874 - DEBUG - VM ctest-TestBasicVMVN-65836183-71761824 is ready for SSH connections 2025-03-10 02:27:02,874 - INFO - Retry 0 2025-03-10 02:27:02,874 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.60, gateway password: c0ntrail123 2025-03-10 02:27:02,874 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-03-10 02:27:04,508 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-03-10 02:27:04,508 - INFO - Generic metadata worked 2025-03-10 02:27:04,742 - DEBUG - Link local service introspect removed 2025-03-10 02:27:04,743 - INFO - Deleting VM ctest-TestBasicVMVN-65836183-71761824 2025-03-10 02:27:04,804 - INFO - Deleting VN ctest-vn2_metadata-11532966 2025-03-10 02:27:04,839 - DEBUG - VN 3d37c187-73ef-4d54-94ba-f6362c66f230 still in use: Unable to complete operation on network 3d37c187-73ef-4d54-94ba-f6362c66f230. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-faab4b87-2eae-492c-921f-6c278ac74e6c'] 2025-03-10 02:27:04,839 - WARNING - Deleting VN ctest-vn2_metadata-11532966 failed..Will retry 2025-03-10 02:27:06,932 - DEBUG - Response for deleting network () 2025-03-10 02:27:07,193 - DEBUG - No XMPP flaps were noticed during the test 2025-03-10 02:27:07,193 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:18] 2025-03-10 02:27:07,193 - INFO - -------------------------------------------------------------------------------- 2025-03-10 02:27:07,196 - INFO - ================================================================================ 2025-03-10 02:27:07,196 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-03-10 02:27:07,196 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-03-10 02:27:07,493 - DEBUG - Nothing to compare xmpp stats {'10.0.0.60': {'10.20.0.14': '0'}} with 2025-03-10 02:27:07,493 - INFO - Initial checks done. Running the testcase now 2025-03-10 02:27:07,493 - INFO - 2025-03-10 02:27:07,971 - DEBUG - Response for create_network : {'network': {'id': 'b58f40e3-adc3-489f-8fe5-ae8ebea44bca', 'name': 'ctest-vn-26201403', 'tenant_id': '28ec74cdfb8c4191a578f1506b4c9b83', 'project_id': '28ec74cdfb8c4191a578f1506b4c9b83', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-65836183', 'ctest-vn-26201403'], 'port_security_enabled': True, 'description': ''}} 2025-03-10 02:27:08,274 - DEBUG - Response for create_subnet : {'subnet': {'id': 'dc9c9671-d9f9-4fee-a1a3-d8c36b1cb5f1', 'name': '', 'tenant_id': '28ec74cdfb8c4191a578f1506b4c9b83', 'network_id': 'b58f40e3-adc3-489f-8fe5-ae8ebea44bca', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': '28ec74cdfb8c4191a578f1506b4c9b83'}} 2025-03-10 02:27:08,482 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b05a49b7-098e-47e3-9d92-9392ea5fe31f', 'name': '', 'tenant_id': '28ec74cdfb8c4191a578f1506b4c9b83', 'network_id': 'b58f40e3-adc3-489f-8fe5-ae8ebea44bca', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': '28ec74cdfb8c4191a578f1506b4c9b83'}} 2025-03-10 02:27:08,507 - INFO - Created VN ctest-vn-26201403 2025-03-10 02:27:08,559 - DEBUG - VN ctest-vn-26201403 UUID is b58f40e3-adc3-489f-8fe5-ae8ebea44bca 2025-03-10 02:27:08,940 - DEBUG - Response for create_port : {'port': {'name': '94d41628-6150-4c9a-be0a-b05e16f3f063', 'id': '94d41628-6150-4c9a-be0a-b05e16f3f063', 'tenant_id': '28ec74cdfb8c4191a578f1506b4c9b83', 'network_id': 'b58f40e3-adc3-489f-8fe5-ae8ebea44bca', 'mac_address': '02:94:d4:16:28:61', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': 'dc9c9671-d9f9-4fee-a1a3-d8c36b1cb5f1'}], 'security_groups': ['6fc76d0f-b28e-43f6-8a57-1a30da465dce'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '28ec74cdfb8c4191a578f1506b4c9b83'}} 2025-03-10 02:27:09,112 - DEBUG - Response for create_port : {'port': {'name': 'e1978200-9fbf-4eba-ac9b-24ee7e25524b', 'id': 'e1978200-9fbf-4eba-ac9b-24ee7e25524b', 'tenant_id': '28ec74cdfb8c4191a578f1506b4c9b83', 'network_id': 'b58f40e3-adc3-489f-8fe5-ae8ebea44bca', 'mac_address': '02:e1:97:82:00:9f', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'b05a49b7-098e-47e3-9d92-9392ea5fe31f'}], 'security_groups': ['6fc76d0f-b28e-43f6-8a57-1a30da465dce'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '28ec74cdfb8c4191a578f1506b4c9b83'}} 2025-03-10 02:27:09,471 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2827-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2827-1) 2025-03-10 02:27:09,902 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2827-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2827-1) 2025-03-10 02:27:11,182 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2827-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2827-1) 2025-03-10 02:27:11,183 - DEBUG - Requesting: http://10.0.0.60:8082/domains 2025-03-10 02:27:11,198 - DEBUG - Requesting: http://10.0.0.60:8082/domain/7b12b1ca-5674-413d-9eed-230c5cde7567 2025-03-10 02:27:11,212 - DEBUG - Requesting: http://10.0.0.60:8082/project/28ec74cd-fb8c-4191-a578-f1506b4c9b83 2025-03-10 02:27:11,289 - DEBUG - Requesting: http://10.0.0.60:8082/network-ipam/73b9219c-ba3b-4e98-aec4-c4cd0636fb14 2025-03-10 02:27:11,302 - INFO - Verifications in API Server for IPAM: ctest-ipam-70801613 passed 2025-03-10 02:27:11,309 - DEBUG - Control-node 10.0.0.60 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-65836183:ctest-ipam-70801613', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-65836183', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8338733142076247704', 'uuid-lslong': '12593406842886355732'}, 'enable': 'true', 'created': '2025-03-10T02:27:07', 'last-modified': '2025-03-10T02:27:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.583834'} 2025-03-10 02:27:11,309 - INFO - Verifications in Control node for IPAM: ctest-ipam-70801613 passed 2025-03-10 02:27:11,310 - DEBUG - Requesting: http://10.0.0.60:8082/domains 2025-03-10 02:27:11,317 - DEBUG - Requesting: http://10.0.0.60:8082/domain/7b12b1ca-5674-413d-9eed-230c5cde7567 2025-03-10 02:27:11,328 - DEBUG - Requesting: http://10.0.0.60:8082/project/28ec74cd-fb8c-4191-a578-f1506b4c9b83 2025-03-10 02:27:11,402 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-network/b58f40e3-adc3-489f-8fe5-ae8ebea44bca 2025-03-10 02:27:11,413 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-network/b58f40e3-adc3-489f-8fe5-ae8ebea44bca 2025-03-10 02:27:11,421 - DEBUG - Requesting: http://10.0.0.60:8082/routing-instance/d60e0c26-9528-4505-9a2a-eb7580045163 2025-03-10 02:27:11,429 - DEBUG - Requesting: http://10.0.0.60:8082/routing-instance/d60e0c26-9528-4505-9a2a-eb7580045163 2025-03-10 02:27:11,435 - DEBUG - Requesting: http://10.0.0.60:8082/route-target/fb261360-80ef-403f-8d6e-7e964001663b 2025-03-10 02:27:11,441 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-03-10 02:27:11,441 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-network/b58f40e3-adc3-489f-8fe5-ae8ebea44bca 2025-03-10 02:27:11,449 - DEBUG - Requesting: http://10.0.0.60:8082/routing-instance/d60e0c26-9528-4505-9a2a-eb7580045163 2025-03-10 02:27:11,463 - INFO - Verified VN network id 9 for VN b58f40e3-adc3-489f-8fe5-ae8ebea44bca 2025-03-10 02:27:11,463 - INFO - Verifications in API Server for VN ctest-vn-26201403 passed 2025-03-10 02:27:11,463 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-network/b58f40e3-adc3-489f-8fe5-ae8ebea44bca 2025-03-10 02:27:11,471 - DEBUG - Requesting: http://10.0.0.60:8082/routing-instance/d60e0c26-9528-4505-9a2a-eb7580045163 2025-03-10 02:27:11,478 - DEBUG - Requesting: http://10.0.0.60:8082/routing-instance/d60e0c26-9528-4505-9a2a-eb7580045163 2025-03-10 02:27:11,485 - DEBUG - Requesting: http://10.0.0.60:8082/route-target/fb261360-80ef-403f-8d6e-7e964001663b 2025-03-10 02:27:11,497 - DEBUG - Control-node 10.0.0.60 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-65836183:ctest-vn-26201403', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-65836183', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13082746789151590559', 'uuid-lslong': '10368885645197462474'}, 'enable': 'true', 'created': '2025-03-10T02:27:07', 'last-modified': '2025-03-10T02:27:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.054845'} 2025-03-10 02:27:11,505 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-03-10 02:27:11,505 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-26201403 passed 2025-03-10 02:27:11,506 - DEBUG - ====Verifying policy data for ctest-vn-26201403 in API_Server ====== 2025-03-10 02:27:11,506 - DEBUG - Requesting: http://10.0.0.60:8082/domains 2025-03-10 02:27:11,511 - DEBUG - Requesting: http://10.0.0.60:8082/domain/7b12b1ca-5674-413d-9eed-230c5cde7567 2025-03-10 02:27:11,524 - DEBUG - Requesting: http://10.0.0.60:8082/project/28ec74cd-fb8c-4191-a578-f1506b4c9b83 2025-03-10 02:27:11,626 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-network/b58f40e3-adc3-489f-8fe5-ae8ebea44bca 2025-03-10 02:27:11,676 - DEBUG - =>VN ctest-vn-26201403 has no policy to be verified 2025-03-10 02:27:11,676 - DEBUG - Verifying the vn in opserver 2025-03-10 02:27:11,677 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-65836183:ctest-vn-26201403 virtual network link through opserver 10.0.0.60 2025-03-10 02:27:11,677 - DEBUG - Requesting: http://10.0.0.60:8081/analytics/uves/virtual-networks 2025-03-10 02:27:12,091 - DEBUG - Requesting: http://10.0.0.60:8081/analytics/uves/virtual-networks 2025-03-10 02:27:12,155 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-65836183:ctest-vn-26201403', 'href': 'http://10.0.0.60:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-65836183:ctest-vn-26201403?flat'} 2025-03-10 02:27:12,155 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-65836183:ctest-vn-26201403 is found in opserver 2025-03-10 02:27:12,163 - DEBUG - VRF ids for VN ctest-vn-26201403: {'10.0.0.60': '2'} 2025-03-10 02:27:12,163 - INFO - Waiting for VM ctest-TestBasicVMVN-65836183-92055640 to be up.. 2025-03-10 02:27:12,240 - DEBUG - VM is in ACTIVE state now 2025-03-10 02:27:12,240 - INFO - VM name : ctest-TestBasicVMVN-65836183-92055640 2025-03-10 02:27:12,313 - DEBUG - VM ctest-TestBasicVMVN-65836183-92055640 ID is 3e3bdb35-4f10-414c-826f-9b7b902d020e 2025-03-10 02:27:12,313 - DEBUG - VM ctest-TestBasicVMVN-65836183-92055640 launched on Node cn-jenkins-deploy-platform-ansible-os-2827-1 2025-03-10 02:27:12,403 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-machine/3e3bdb35-4f10-414c-826f-9b7b902d020e 2025-03-10 02:27:12,416 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-machine-interface/94d41628-6150-4c9a-be0a-b05e16f3f063 2025-03-10 02:27:15,688 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2025-03-10 02:27:15,688 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-65836183-92055640 failed! 2025-03-10 02:27:15,743 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-65836183:ctest-vn-26201403 is 31.1.1.1 and allocation pool is NOT set 2025-03-10 02:27:15,743 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-65836183:ctest-vn-26201403 is 31.1.2.1 and allocation pool is NOT set 2025-03-10 02:27:19,815 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-03-10 02:27:19,815 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-65836183-92055640 failed! 2025-03-10 02:27:19,867 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-65836183:ctest-vn-26201403 is 31.1.1.1 and allocation pool is NOT set 2025-03-10 02:27:19,867 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-65836183:ctest-vn-26201403 is 31.1.2.1 and allocation pool is NOT set 2025-03-10 02:27:21,931 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.34 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.341 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.341/1.839/3.337/1.498 ms') 2025-03-10 02:27:21,931 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-65836183-92055640 passed 2025-03-10 02:27:22,079 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-10 02:27:22,079 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-65836183-92055640, IP 31.1.1.4, Port 22 2025-03-10 02:27:22,241 - DEBUG - VM ctest-TestBasicVMVN-65836183-92055640 is ready for SSH connections 2025-03-10 02:27:22,241 - INFO - Waiting for VM ctest-TestBasicVMVN-65836183-27007164 to be up.. 2025-03-10 02:27:22,336 - DEBUG - VM is in ACTIVE state now 2025-03-10 02:27:22,337 - INFO - VM name : ctest-TestBasicVMVN-65836183-27007164 2025-03-10 02:27:22,408 - DEBUG - VM ctest-TestBasicVMVN-65836183-27007164 ID is 875b65af-ab1f-470e-bf02-fef2cb071606 2025-03-10 02:27:22,408 - DEBUG - VM ctest-TestBasicVMVN-65836183-27007164 launched on Node cn-jenkins-deploy-platform-ansible-os-2827-1 2025-03-10 02:27:22,487 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-machine/875b65af-ab1f-470e-bf02-fef2cb071606 2025-03-10 02:27:22,496 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-machine-interface/e1978200-9fbf-4eba-ac9b-24ee7e25524b 2025-03-10 02:27:23,735 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.72 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.431 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.431/1.574/2.718/1.143 ms') 2025-03-10 02:27:23,735 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-65836183-27007164 passed 2025-03-10 02:27:23,882 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-10 02:27:23,883 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-65836183-27007164, IP 31.1.2.4, Port 22 2025-03-10 02:27:24,038 - DEBUG - VM ctest-TestBasicVMVN-65836183-27007164 is ready for SSH connections 2025-03-10 02:27:24,038 - INFO - Waiting for VM ctest-TestBasicVMVN-65836183-36958754 to be up.. 2025-03-10 02:27:24,108 - DEBUG - VM is in ACTIVE state now 2025-03-10 02:27:24,108 - INFO - VM name : ctest-TestBasicVMVN-65836183-36958754 2025-03-10 02:27:24,181 - DEBUG - VM ctest-TestBasicVMVN-65836183-36958754 ID is e5b216e9-47c6-45ed-ab52-1fbd78566d57 2025-03-10 02:27:24,181 - DEBUG - VM ctest-TestBasicVMVN-65836183-36958754 launched on Node cn-jenkins-deploy-platform-ansible-os-2827-1 2025-03-10 02:27:24,259 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-machine/e5b216e9-47c6-45ed-ab52-1fbd78566d57 2025-03-10 02:27:24,268 - DEBUG - Requesting: http://10.0.0.60:8082/virtual-machine-interface/ab0866f2-ad33-4507-8fff-bddf6d1aa81a 2025-03-10 02:27:25,498 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=2.67 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.351 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.351/1.508/2.666/1.157 ms') 2025-03-10 02:27:25,498 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-65836183-36958754 passed 2025-03-10 02:27:25,647 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-10 02:27:25,647 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-65836183-36958754, IP 31.1.1.3, Port 22 2025-03-10 02:27:25,798 - DEBUG - VM ctest-TestBasicVMVN-65836183-36958754 is ready for SSH connections 2025-03-10 02:27:25,799 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-10 02:27:25,799 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.60, gateway password: c0ntrail123 2025-03-10 02:27:25,799 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2025-03-10 02:27:29,626 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.603 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.816 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=1.000 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.816/1.806/3.603 ms 2025-03-10 02:27:29,626 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-65836183-92055640 passed 2025-03-10 02:27:29,626 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-10 02:27:29,626 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.60, gateway password: c0ntrail123 2025-03-10 02:27:29,626 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2025-03-10 02:27:33,261 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=2.726 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.850 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=0.761 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.761/1.445/2.726 ms 2025-03-10 02:27:33,261 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-65836183-27007164 passed 2025-03-10 02:27:33,261 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-10 02:27:33,261 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-10 02:27:33,261 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-10 02:27:33,261 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.60, gateway password: c0ntrail123 2025-03-10 02:27:33,261 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-03-10 02:27:33,444 - DEBUG - None 2025-03-10 02:27:33,444 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.60, gateway password: c0ntrail123 2025-03-10 02:27:33,444 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-03-10 02:27:33,618 - DEBUG - None 2025-03-10 02:27:33,618 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.60, gateway password: c0ntrail123 2025-03-10 02:27:33,618 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-03-10 02:27:34,209 - DEBUG - None 2025-03-10 02:27:34,209 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.60, gateway password: c0ntrail123 2025-03-10 02:27:34,209 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2025-03-10 02:27:36,404 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.740 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.751 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.376 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.775 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.519 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.376/1.832/4.751 ms 2025-03-10 02:27:36,404 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.60, gateway password: c0ntrail123 2025-03-10 02:27:36,404 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2025-03-10 02:27:38,641 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.136 ms 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.665 ms (DUP!) 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.935 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.383 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.556 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.331 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.408 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.383/2.059/4.935 ms 2025-03-10 02:27:38,642 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.60, gateway password: c0ntrail123 2025-03-10 02:27:38,642 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2025-03-10 02:27:40,872 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.641 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=2.455 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.452 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.428 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.677 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.607 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.361 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.361/1.660/3.452 ms 2025-03-10 02:27:40,872 - INFO - Deleting VM ctest-TestBasicVMVN-65836183-36958754 2025-03-10 02:27:40,933 - INFO - Detaching port e1978200-9fbf-4eba-ac9b-24ee7e25524b from VM ctest-TestBasicVMVN-65836183-27007164 2025-03-10 02:27:40,979 - INFO - Deleting VM ctest-TestBasicVMVN-65836183-27007164 2025-03-10 02:27:41,056 - INFO - Detaching port 94d41628-6150-4c9a-be0a-b05e16f3f063 from VM ctest-TestBasicVMVN-65836183-92055640 2025-03-10 02:27:41,090 - INFO - Deleting VM ctest-TestBasicVMVN-65836183-92055640 2025-03-10 02:27:41,181 - INFO - Deleting VN ctest-vn-26201403 2025-03-10 02:27:41,325 - DEBUG - Response for delete_port : () 2025-03-10 02:27:41,530 - DEBUG - Response for delete_port : () 2025-03-10 02:27:41,568 - DEBUG - VN b58f40e3-adc3-489f-8fe5-ae8ebea44bca still in use: Unable to complete operation on network b58f40e3-adc3-489f-8fe5-ae8ebea44bca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-65cfc462-d558-4332-806d-36f70102b75a'] 2025-03-10 02:27:41,569 - WARNING - Deleting VN ctest-vn-26201403 failed..Will retry 2025-03-10 02:27:43,675 - DEBUG - Response for deleting network () 2025-03-10 02:27:43,675 - DEBUG - Requesting: http://10.0.0.60:8082/routing-instance/d60e0c26-9528-4505-9a2a-eb7580045163 2025-03-10 02:27:43,681 - DEBUG - Response Code: 404 2025-03-10 02:27:43,681 - DEBUG - Requesting: http://10.0.0.60:8082/domains 2025-03-10 02:27:43,692 - DEBUG - Requesting: http://10.0.0.60:8082/domain/7b12b1ca-5674-413d-9eed-230c5cde7567 2025-03-10 02:27:43,747 - DEBUG - Requesting: http://10.0.0.60:8082/project/28ec74cd-fb8c-4191-a578-f1506b4c9b83 2025-03-10 02:27:43,814 - INFO - Validated that VN ctest-vn-26201403 is not found in API Server 2025-03-10 02:27:43,827 - DEBUG - VN ctest-vn-26201403 is not present in Agent 10.0.0.60 2025-03-10 02:27:43,827 - INFO - Validated that VN ctest-vn-26201403 is not in any agent 2025-03-10 02:27:43,838 - DEBUG - VRF 2 is not seen in agent 10.0.0.60 2025-03-10 02:27:43,846 - DEBUG - Vrouter 10.0.0.60 does not have vrf 2 for VN ctest-vn-26201403 2025-03-10 02:27:43,846 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-65836183:ctest-vn-26201403 2025-03-10 02:27:43,857 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-26201403 info 2025-03-10 02:27:43,938 - INFO - IPAM: ctest-ipam-70801613 is not found in API Server 2025-03-10 02:27:43,950 - INFO - IPAM:ctest-ipam-70801613 is not found in control node 2025-03-10 02:27:44,205 - DEBUG - No XMPP flaps were noticed during the test 2025-03-10 02:27:44,205 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:37] 2025-03-10 02:27:44,206 - INFO - -------------------------------------------------------------------------------- 2025-03-10 02:27:44,902 - INFO - Deleted project: ctest-TestBasicVMVN-65836183, ID : 28ec74cd-fb8c-4191-a578-f1506b4c9b83