2024-11-08 18:31:22,251 - INFO - Domain Default found not creating 2024-11-08 18:31:22,419 - INFO - Project ctest-TestBasicVMVN-73077085 not found, creating it 2024-11-08 18:31:22,917 - INFO - Created Project:ctest-TestBasicVMVN-73077085, ID : feb76178-267d-43d6-b6df-a2234c708cf5 2024-11-08 18:31:24,630 - INFO - ================================================================================ 2024-11-08 18:31:24,630 - INFO - STARTING TEST : test_generic_link_local_service 2024-11-08 18:31:24,630 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2024-11-08 18:31:24,888 - DEBUG - Nothing to compare xmpp stats {'10.0.0.31': {'10.20.0.18': '0'}} with 2024-11-08 18:31:24,889 - INFO - Initial checks done. Running the testcase now 2024-11-08 18:31:24,889 - INFO - 2024-11-08 18:31:25,839 - DEBUG - Response for create_network : {'network': {'id': 'a92811fb-e716-4f19-a0e7-6d10929e91e1', 'name': 'ctest-vn2_metadata-53407883', 'tenant_id': 'feb76178267d43d6b6dfa2234c708cf5', 'project_id': 'feb76178267d43d6b6dfa2234c708cf5', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-73077085', 'ctest-vn2_metadata-53407883'], 'port_security_enabled': True, 'description': ''}} 2024-11-08 18:31:26,062 - DEBUG - Response for create_subnet : {'subnet': {'id': '0588576c-824c-48ce-a599-d75c201018d5', 'name': '', 'tenant_id': 'feb76178267d43d6b6dfa2234c708cf5', 'network_id': 'a92811fb-e716-4f19-a0e7-6d10929e91e1', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'feb76178267d43d6b6dfa2234c708cf5'}} 2024-11-08 18:31:26,083 - INFO - Created VN ctest-vn2_metadata-53407883 2024-11-08 18:31:26,144 - DEBUG - VN ctest-vn2_metadata-53407883 UUID is a92811fb-e716-4f19-a0e7-6d10929e91e1 2024-11-08 18:31:26,354 - DEBUG - Services list from nova: [, , ] 2024-11-08 18:31:27,559 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2239-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2239-1) 2024-11-08 18:31:27,672 - DEBUG - Link local service introspect added 2024-11-08 18:31:27,718 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-11-08 18:31:32,810 - DEBUG - VM is in ACTIVE state now 2024-11-08 18:31:32,939 - INFO - Waiting for VM ctest-TestBasicVMVN-73077085-10325947 to be up.. 2024-11-08 18:31:32,939 - INFO - VM name : ctest-TestBasicVMVN-73077085-10325947 2024-11-08 18:31:33,021 - DEBUG - VM ctest-TestBasicVMVN-73077085-10325947 ID is f435b2a1-463f-4c7c-9071-fb50facee599 2024-11-08 18:31:33,022 - DEBUG - VM ctest-TestBasicVMVN-73077085-10325947 launched on Node cn-jenkins-deploy-platform-ansible-os-2239-1 2024-11-08 18:31:33,102 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-machine/f435b2a1-463f-4c7c-9071-fb50facee599 2024-11-08 18:31:33,438 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-machine/f435b2a1-463f-4c7c-9071-fb50facee599 2024-11-08 18:31:33,474 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-machine-interface/2b7e5971-a738-45ae-9b21-7bbc3b1a7a9a 2024-11-08 18:31:36,743 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2024-11-08 18:31:36,743 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-73077085-10325947 failed! 2024-11-08 18:31:36,804 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-73077085:ctest-vn2_metadata-53407883 is 11.1.1.1 and allocation pool is NOT set 2024-11-08 18:31:38,871 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.20 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.86 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.859/4.530/7.202/2.671 ms') 2024-11-08 18:31:38,872 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-73077085-10325947 passed 2024-11-08 18:31:39,032 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-08 18:31:39,033 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-73077085-10325947, IP 11.1.1.3, Port 22 2024-11-08 18:31:39,099 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-11-08 18:31:39,186 - DEBUG - VM ctest-TestBasicVMVN-73077085-10325947 is NOT ready for SSH connections, VM status: ACTIVE 2024-11-08 18:31:44,186 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-08 18:31:44,187 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-73077085-10325947, IP 11.1.1.3, Port 22 2024-11-08 18:31:44,344 - DEBUG - VM ctest-TestBasicVMVN-73077085-10325947 is ready for SSH connections 2024-11-08 18:31:44,344 - INFO - Retry 0 2024-11-08 18:31:44,344 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.31, gateway password: c0ntrail123 2024-11-08 18:31:44,344 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2024-11-08 18:31:45,995 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2024-11-08 18:31:45,995 - INFO - Generic metadata worked 2024-11-08 18:31:46,304 - DEBUG - Link local service introspect removed 2024-11-08 18:31:46,304 - INFO - Deleting VM ctest-TestBasicVMVN-73077085-10325947 2024-11-08 18:31:46,373 - INFO - Deleting VN ctest-vn2_metadata-53407883 2024-11-08 18:31:46,441 - DEBUG - VN a92811fb-e716-4f19-a0e7-6d10929e91e1 still in use: Unable to complete operation on network a92811fb-e716-4f19-a0e7-6d10929e91e1. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a8a821cc-de24-45d5-892c-eb81fbeed19d'] 2024-11-08 18:31:46,441 - WARNING - Deleting VN ctest-vn2_metadata-53407883 failed..Will retry 2024-11-08 18:31:48,616 - DEBUG - Response for deleting network () 2024-11-08 18:31:48,878 - DEBUG - No XMPP flaps were noticed during the test 2024-11-08 18:31:48,878 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:24] 2024-11-08 18:31:48,878 - INFO - -------------------------------------------------------------------------------- 2024-11-08 18:31:48,881 - INFO - ================================================================================ 2024-11-08 18:31:48,881 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2024-11-08 18:31:48,881 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2024-11-08 18:31:49,166 - DEBUG - Nothing to compare xmpp stats {'10.0.0.31': {'10.20.0.18': '0'}} with 2024-11-08 18:31:49,167 - INFO - Initial checks done. Running the testcase now 2024-11-08 18:31:49,167 - INFO - 2024-11-08 18:31:49,800 - DEBUG - Response for create_network : {'network': {'id': '48a6a7be-27e8-4cce-836f-ba414049b15c', 'name': 'ctest-vn-72986140', 'tenant_id': 'feb76178267d43d6b6dfa2234c708cf5', 'project_id': 'feb76178267d43d6b6dfa2234c708cf5', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-73077085', 'ctest-vn-72986140'], 'port_security_enabled': True, 'description': ''}} 2024-11-08 18:31:49,970 - DEBUG - Response for create_subnet : {'subnet': {'id': '4f13fa68-6d98-457c-b11c-308f9b0fe8ab', 'name': '', 'tenant_id': 'feb76178267d43d6b6dfa2234c708cf5', 'network_id': '48a6a7be-27e8-4cce-836f-ba414049b15c', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'feb76178267d43d6b6dfa2234c708cf5'}} 2024-11-08 18:31:50,287 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ed46b752-a616-44a6-b4e9-a76b3453fdd1', 'name': '', 'tenant_id': 'feb76178267d43d6b6dfa2234c708cf5', 'network_id': '48a6a7be-27e8-4cce-836f-ba414049b15c', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'feb76178267d43d6b6dfa2234c708cf5'}} 2024-11-08 18:31:50,332 - INFO - Created VN ctest-vn-72986140 2024-11-08 18:31:50,396 - DEBUG - VN ctest-vn-72986140 UUID is 48a6a7be-27e8-4cce-836f-ba414049b15c 2024-11-08 18:31:50,895 - DEBUG - Response for create_port : {'port': {'name': '12f6bd54-ba3b-47a4-8b53-14e70b1c7cb4', 'id': '12f6bd54-ba3b-47a4-8b53-14e70b1c7cb4', 'tenant_id': 'feb76178267d43d6b6dfa2234c708cf5', 'network_id': '48a6a7be-27e8-4cce-836f-ba414049b15c', 'mac_address': '02:12:f6:bd:54:ba', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '4f13fa68-6d98-457c-b11c-308f9b0fe8ab'}], 'security_groups': ['709d5111-9f46-44f7-b6ca-1013660f9c5e'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'feb76178267d43d6b6dfa2234c708cf5'}} 2024-11-08 18:31:51,119 - DEBUG - Response for create_port : {'port': {'name': '7213f98e-18c0-4369-8960-ce9ae74503cb', 'id': '7213f98e-18c0-4369-8960-ce9ae74503cb', 'tenant_id': 'feb76178267d43d6b6dfa2234c708cf5', 'network_id': '48a6a7be-27e8-4cce-836f-ba414049b15c', 'mac_address': '02:72:13:f9:8e:18', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'ed46b752-a616-44a6-b4e9-a76b3453fdd1'}], 'security_groups': ['709d5111-9f46-44f7-b6ca-1013660f9c5e'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'feb76178267d43d6b6dfa2234c708cf5'}} 2024-11-08 18:31:51,542 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2239-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2239-1) 2024-11-08 18:31:51,972 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2239-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2239-1) 2024-11-08 18:31:53,515 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2239-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2239-1) 2024-11-08 18:31:53,516 - DEBUG - Requesting: http://10.0.0.31:8082/domains 2024-11-08 18:31:53,525 - DEBUG - Requesting: http://10.0.0.31:8082/domain/5d60838b-5a12-4335-bc4c-cc3d05d3a45c 2024-11-08 18:31:53,541 - DEBUG - Requesting: http://10.0.0.31:8082/project/feb76178-267d-43d6-b6df-a2234c708cf5 2024-11-08 18:31:53,640 - DEBUG - Requesting: http://10.0.0.31:8082/network-ipam/c2fa79d0-f8ad-4028-bec5-29e02601be02 2024-11-08 18:31:53,661 - INFO - Verifications in API Server for IPAM: ctest-ipam-49251241 passed 2024-11-08 18:31:53,669 - DEBUG - Control-node 10.0.0.31 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-73077085:ctest-ipam-49251241', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-73077085', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14049675925967945768', 'uuid-lslong': '13746439480305368578'}, 'enable': 'true', 'created': '2024-11-08T18:31:49', 'last-modified': '2024-11-08T18:31:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.221548'} 2024-11-08 18:31:53,669 - INFO - Verifications in Control node for IPAM: ctest-ipam-49251241 passed 2024-11-08 18:31:53,670 - DEBUG - Requesting: http://10.0.0.31:8082/domains 2024-11-08 18:31:53,685 - DEBUG - Requesting: http://10.0.0.31:8082/domain/5d60838b-5a12-4335-bc4c-cc3d05d3a45c 2024-11-08 18:31:53,728 - DEBUG - Requesting: http://10.0.0.31:8082/project/feb76178-267d-43d6-b6df-a2234c708cf5 2024-11-08 18:31:53,835 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-network/48a6a7be-27e8-4cce-836f-ba414049b15c 2024-11-08 18:31:53,855 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-network/48a6a7be-27e8-4cce-836f-ba414049b15c 2024-11-08 18:31:53,892 - DEBUG - Requesting: http://10.0.0.31:8082/routing-instance/d54008b5-2310-4de5-b26c-2faaa29c498c 2024-11-08 18:31:53,908 - DEBUG - Requesting: http://10.0.0.31:8082/routing-instance/d54008b5-2310-4de5-b26c-2faaa29c498c 2024-11-08 18:31:53,926 - DEBUG - Requesting: http://10.0.0.31:8082/route-target/cf4532a3-3f37-444f-85d9-c437e469da00 2024-11-08 18:31:53,946 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-11-08 18:31:53,946 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-network/48a6a7be-27e8-4cce-836f-ba414049b15c 2024-11-08 18:31:53,964 - DEBUG - Requesting: http://10.0.0.31:8082/routing-instance/d54008b5-2310-4de5-b26c-2faaa29c498c 2024-11-08 18:31:53,994 - INFO - Verified VN network id 8 for VN 48a6a7be-27e8-4cce-836f-ba414049b15c 2024-11-08 18:31:53,994 - INFO - Verifications in API Server for VN ctest-vn-72986140 passed 2024-11-08 18:31:53,994 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-network/48a6a7be-27e8-4cce-836f-ba414049b15c 2024-11-08 18:31:54,019 - DEBUG - Requesting: http://10.0.0.31:8082/routing-instance/d54008b5-2310-4de5-b26c-2faaa29c498c 2024-11-08 18:31:54,044 - DEBUG - Requesting: http://10.0.0.31:8082/routing-instance/d54008b5-2310-4de5-b26c-2faaa29c498c 2024-11-08 18:31:54,059 - DEBUG - Requesting: http://10.0.0.31:8082/route-target/cf4532a3-3f37-444f-85d9-c437e469da00 2024-11-08 18:31:54,081 - DEBUG - Control-node 10.0.0.31 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-73077085:ctest-vn-72986140', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-73077085', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5235056052019940558', 'uuid-lslong': '9470993330797654364'}, 'enable': 'true', 'created': '2024-11-08T18:31:49', 'last-modified': '2024-11-08T18:31:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.851900'} 2024-11-08 18:31:54,089 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-11-08 18:31:54,090 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-72986140 passed 2024-11-08 18:31:54,090 - DEBUG - ====Verifying policy data for ctest-vn-72986140 in API_Server ====== 2024-11-08 18:31:54,090 - DEBUG - Requesting: http://10.0.0.31:8082/domains 2024-11-08 18:31:54,098 - DEBUG - Requesting: http://10.0.0.31:8082/domain/5d60838b-5a12-4335-bc4c-cc3d05d3a45c 2024-11-08 18:31:54,116 - DEBUG - Requesting: http://10.0.0.31:8082/project/feb76178-267d-43d6-b6df-a2234c708cf5 2024-11-08 18:31:54,329 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-network/48a6a7be-27e8-4cce-836f-ba414049b15c 2024-11-08 18:31:54,380 - DEBUG - =>VN ctest-vn-72986140 has no policy to be verified 2024-11-08 18:31:54,381 - DEBUG - Verifying the vn in opserver 2024-11-08 18:31:54,381 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-73077085:ctest-vn-72986140 virtual network link through opserver 10.0.0.31 2024-11-08 18:31:54,381 - DEBUG - Requesting: http://10.0.0.31:8081/analytics/uves/virtual-networks 2024-11-08 18:31:54,894 - DEBUG - Requesting: http://10.0.0.31:8081/analytics/uves/virtual-networks 2024-11-08 18:31:55,000 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-73077085:ctest-vn-72986140', 'href': 'http://10.0.0.31:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-73077085:ctest-vn-72986140?flat'} 2024-11-08 18:31:55,000 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-73077085:ctest-vn-72986140 is found in opserver 2024-11-08 18:31:55,008 - DEBUG - VRF ids for VN ctest-vn-72986140: {'10.0.0.31': '2'} 2024-11-08 18:31:55,008 - INFO - Waiting for VM ctest-TestBasicVMVN-73077085-51365997 to be up.. 2024-11-08 18:31:55,120 - DEBUG - VM is in ACTIVE state now 2024-11-08 18:31:55,120 - INFO - VM name : ctest-TestBasicVMVN-73077085-51365997 2024-11-08 18:31:55,245 - DEBUG - VM ctest-TestBasicVMVN-73077085-51365997 ID is acbaf64b-3ed4-4e94-a5c6-eec6e37bf525 2024-11-08 18:31:55,245 - DEBUG - VM ctest-TestBasicVMVN-73077085-51365997 launched on Node cn-jenkins-deploy-platform-ansible-os-2239-1 2024-11-08 18:31:55,412 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-machine/acbaf64b-3ed4-4e94-a5c6-eec6e37bf525 2024-11-08 18:31:55,435 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-machine-interface/12f6bd54-ba3b-47a4-8b53-14e70b1c7cb4 2024-11-08 18:31:58,756 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2024-11-08 18:31:58,756 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-73077085-51365997 failed! 2024-11-08 18:31:58,824 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-73077085:ctest-vn-72986140 is 31.1.1.1 and allocation pool is NOT set 2024-11-08 18:31:58,825 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-73077085:ctest-vn-72986140 is 31.1.2.1 and allocation pool is NOT set 2024-11-08 18:32:02,886 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2024-11-08 18:32:02,886 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-73077085-51365997 failed! 2024-11-08 18:32:02,953 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-73077085:ctest-vn-72986140 is 31.1.1.1 and allocation pool is NOT set 2024-11-08 18:32:02,953 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-73077085:ctest-vn-72986140 is 31.1.2.1 and allocation pool is NOT set 2024-11-08 18:32:05,012 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.94 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.61 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.607/6.273/9.939/3.666 ms') 2024-11-08 18:32:05,012 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-73077085-51365997 passed 2024-11-08 18:32:05,180 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-08 18:32:05,181 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-73077085-51365997, IP 31.1.1.4, Port 22 2024-11-08 18:32:05,247 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-11-08 18:32:05,365 - DEBUG - VM ctest-TestBasicVMVN-73077085-51365997 is NOT ready for SSH connections, VM status: ACTIVE 2024-11-08 18:32:10,366 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-08 18:32:10,366 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-73077085-51365997, IP 31.1.1.4, Port 22 2024-11-08 18:32:10,524 - DEBUG - VM ctest-TestBasicVMVN-73077085-51365997 is ready for SSH connections 2024-11-08 18:32:10,524 - INFO - Waiting for VM ctest-TestBasicVMVN-73077085-10844416 to be up.. 2024-11-08 18:32:10,605 - DEBUG - VM is in ACTIVE state now 2024-11-08 18:32:10,606 - INFO - VM name : ctest-TestBasicVMVN-73077085-10844416 2024-11-08 18:32:10,689 - DEBUG - VM ctest-TestBasicVMVN-73077085-10844416 ID is 24fa44fa-5037-4e7a-be4e-0e2df84e8edc 2024-11-08 18:32:10,689 - DEBUG - VM ctest-TestBasicVMVN-73077085-10844416 launched on Node cn-jenkins-deploy-platform-ansible-os-2239-1 2024-11-08 18:32:10,774 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-machine/24fa44fa-5037-4e7a-be4e-0e2df84e8edc 2024-11-08 18:32:10,784 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-machine-interface/7213f98e-18c0-4369-8960-ce9ae74503cb 2024-11-08 18:32:12,037 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.31 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.364 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.364/1.836/3.309/1.472 ms') 2024-11-08 18:32:12,037 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-73077085-10844416 passed 2024-11-08 18:32:12,200 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-08 18:32:12,201 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-73077085-10844416, IP 31.1.2.4, Port 22 2024-11-08 18:32:12,360 - DEBUG - VM ctest-TestBasicVMVN-73077085-10844416 is ready for SSH connections 2024-11-08 18:32:12,360 - INFO - Waiting for VM ctest-TestBasicVMVN-73077085-17393900 to be up.. 2024-11-08 18:32:12,447 - DEBUG - VM is in ACTIVE state now 2024-11-08 18:32:12,447 - INFO - VM name : ctest-TestBasicVMVN-73077085-17393900 2024-11-08 18:32:12,530 - DEBUG - VM ctest-TestBasicVMVN-73077085-17393900 ID is 5e082d62-d066-4251-a16a-2a8c2836a633 2024-11-08 18:32:12,530 - DEBUG - VM ctest-TestBasicVMVN-73077085-17393900 launched on Node cn-jenkins-deploy-platform-ansible-os-2239-1 2024-11-08 18:32:12,625 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-machine/5e082d62-d066-4251-a16a-2a8c2836a633 2024-11-08 18:32:12,637 - DEBUG - Requesting: http://10.0.0.31:8082/virtual-machine-interface/004d9993-8353-4bfb-9e7c-98c231a2e424 2024-11-08 18:32:13,888 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.46 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.444 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.444/1.951/3.459/1.507 ms') 2024-11-08 18:32:13,888 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-73077085-17393900 passed 2024-11-08 18:32:14,052 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-08 18:32:14,053 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-73077085-17393900, IP 31.1.1.3, Port 22 2024-11-08 18:32:14,208 - DEBUG - VM ctest-TestBasicVMVN-73077085-17393900 is ready for SSH connections 2024-11-08 18:32:14,208 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-08 18:32:14,208 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.31, gateway password: c0ntrail123 2024-11-08 18:32:14,209 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2024-11-08 18:32:17,945 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.747 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.909 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=0.737 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.737/1.797/3.747 ms 2024-11-08 18:32:17,945 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-73077085-51365997 passed 2024-11-08 18:32:17,945 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-08 18:32:17,945 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.31, gateway password: c0ntrail123 2024-11-08 18:32:17,945 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2024-11-08 18:32:21,984 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=3.420 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.852 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=0.790 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.790/1.687/3.420 ms 2024-11-08 18:32:21,984 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-73077085-10844416 passed 2024-11-08 18:32:21,984 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-08 18:32:21,984 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-08 18:32:21,984 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-08 18:32:21,984 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.31, gateway password: c0ntrail123 2024-11-08 18:32:21,984 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-11-08 18:32:22,181 - DEBUG - None 2024-11-08 18:32:22,181 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.31, gateway password: c0ntrail123 2024-11-08 18:32:22,181 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-11-08 18:32:22,386 - DEBUG - None 2024-11-08 18:32:22,387 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.31, gateway password: c0ntrail123 2024-11-08 18:32:22,387 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-11-08 18:32:23,049 - DEBUG - None 2024-11-08 18:32:23,050 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.31, gateway password: c0ntrail123 2024-11-08 18:32:23,050 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2024-11-08 18:32:25,284 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.335 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=5.891 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.497 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.840 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.429 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.429/2.198/5.891 ms 2024-11-08 18:32:25,285 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.31, gateway password: c0ntrail123 2024-11-08 18:32:25,285 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2024-11-08 18:32:27,570 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.443 ms 64 bytes from 31.1.2.4: seq=0 ttl=63 time=5.792 ms (DUP!) 64 bytes from 31.1.1.3: seq=0 ttl=64 time=6.945 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.420 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.518 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=4.330 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.423 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.420/3.267/6.945 ms 2024-11-08 18:32:27,570 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.31, gateway password: c0ntrail123 2024-11-08 18:32:27,570 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2024-11-08 18:32:29,825 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.727 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=2.701 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.570 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.463 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.738 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.578 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.417 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.417/1.742/3.570 ms 2024-11-08 18:32:29,825 - INFO - Deleting VM ctest-TestBasicVMVN-73077085-17393900 2024-11-08 18:32:29,912 - INFO - Detaching port 7213f98e-18c0-4369-8960-ce9ae74503cb from VM ctest-TestBasicVMVN-73077085-10844416 2024-11-08 18:32:29,997 - INFO - Deleting VM ctest-TestBasicVMVN-73077085-10844416 2024-11-08 18:32:30,105 - INFO - Detaching port 12f6bd54-ba3b-47a4-8b53-14e70b1c7cb4 from VM ctest-TestBasicVMVN-73077085-51365997 2024-11-08 18:32:30,157 - INFO - Deleting VM ctest-TestBasicVMVN-73077085-51365997 2024-11-08 18:32:30,255 - INFO - Deleting VN ctest-vn-72986140 2024-11-08 18:32:30,519 - DEBUG - Response for delete_port : () 2024-11-08 18:32:30,802 - DEBUG - Response for delete_port : () 2024-11-08 18:32:30,870 - DEBUG - VN 48a6a7be-27e8-4cce-836f-ba414049b15c still in use: Unable to complete operation on network 48a6a7be-27e8-4cce-836f-ba414049b15c. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-ab09f802-da4c-4017-852c-42edc7296f13'] 2024-11-08 18:32:30,870 - WARNING - Deleting VN ctest-vn-72986140 failed..Will retry 2024-11-08 18:32:33,049 - DEBUG - Response for deleting network () 2024-11-08 18:32:33,049 - DEBUG - Requesting: http://10.0.0.31:8082/routing-instance/d54008b5-2310-4de5-b26c-2faaa29c498c 2024-11-08 18:32:33,058 - DEBUG - Response Code: 404 2024-11-08 18:32:33,058 - DEBUG - Requesting: http://10.0.0.31:8082/domains 2024-11-08 18:32:33,064 - DEBUG - Requesting: http://10.0.0.31:8082/domain/5d60838b-5a12-4335-bc4c-cc3d05d3a45c 2024-11-08 18:32:33,120 - DEBUG - Requesting: http://10.0.0.31:8082/project/feb76178-267d-43d6-b6df-a2234c708cf5 2024-11-08 18:32:33,219 - INFO - Validated that VN ctest-vn-72986140 is not found in API Server 2024-11-08 18:32:33,233 - DEBUG - VN ctest-vn-72986140 is not present in Agent 10.0.0.31 2024-11-08 18:32:33,233 - INFO - Validated that VN ctest-vn-72986140 is not in any agent 2024-11-08 18:32:33,241 - DEBUG - VRF 2 is not seen in agent 10.0.0.31 2024-11-08 18:32:33,256 - DEBUG - Vrouter 10.0.0.31 does not have vrf 2 for VN ctest-vn-72986140 2024-11-08 18:32:33,256 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-73077085:ctest-vn-72986140 2024-11-08 18:32:33,275 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-72986140 info 2024-11-08 18:32:33,372 - INFO - IPAM: ctest-ipam-49251241 is not found in API Server 2024-11-08 18:32:33,385 - INFO - IPAM:ctest-ipam-49251241 is not found in control node 2024-11-08 18:32:33,647 - DEBUG - No XMPP flaps were noticed during the test 2024-11-08 18:32:33,647 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:45] 2024-11-08 18:32:33,647 - INFO - -------------------------------------------------------------------------------- 2024-11-08 18:32:34,429 - INFO - Deleted project: ctest-TestBasicVMVN-73077085, ID : feb76178-267d-43d6-b6df-a2234c708cf5