2025-08-13 14:51:42,005 - INFO - Domain Default found not creating 2025-08-13 14:51:42,148 - INFO - Project ctest-TestRouters-16038378 not found, creating it 2025-08-13 14:51:42,608 - INFO - Created Project:ctest-TestRouters-16038378, ID : aec4ef43-18ff-4dd2-87a7-5c3037db4c93 2025-08-13 14:51:44,073 - INFO - ================================================================================ 2025-08-13 14:51:44,073 - INFO - STARTING TEST : test_basic_router_behavior 2025-08-13 14:51:44,073 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs Create a router Create 2 VNs, and a VM in each Add router port from each VN Ping between VMs 2025-08-13 14:51:44,336 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.17': '0'}} with 2025-08-13 14:51:44,337 - INFO - Initial checks done. Running the testcase now 2025-08-13 14:51:44,337 - INFO - 2025-08-13 14:51:44,922 - DEBUG - Response for create_network : {'network': {'id': '55b4f591-1ba6-432f-a765-ebbca7cdc803', 'name': 'ctest-vn1-06980474', 'tenant_id': 'aec4ef4318ff4dd287a75c3037db4c93', 'project_id': 'aec4ef4318ff4dd287a75c3037db4c93', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-16038378', 'ctest-vn1-06980474'], 'port_security_enabled': True, 'description': ''}} 2025-08-13 14:51:45,122 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ea4b16e0-b197-45dd-a98a-7a0dd9d93752', 'name': '', 'tenant_id': 'aec4ef4318ff4dd287a75c3037db4c93', 'network_id': '55b4f591-1ba6-432f-a765-ebbca7cdc803', 'ip_version': 4, 'cidr': '210.60.40.128/26', 'allocation_pools': [{'start': '210.60.40.130', 'end': '210.60.40.190'}], 'gateway_ip': '210.60.40.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '210.60.40.130', 'tags': [], 'project_id': 'aec4ef4318ff4dd287a75c3037db4c93'}} 2025-08-13 14:51:45,140 - INFO - Created VN ctest-vn1-06980474 2025-08-13 14:51:45,194 - DEBUG - VN ctest-vn1-06980474 UUID is 55b4f591-1ba6-432f-a765-ebbca7cdc803 2025-08-13 14:51:45,506 - DEBUG - Response for create_network : {'network': {'id': 'b02b719b-99d3-4886-beeb-b89d0a80bc20', 'name': 'ctest-vn2-81919913', 'tenant_id': 'aec4ef4318ff4dd287a75c3037db4c93', 'project_id': 'aec4ef4318ff4dd287a75c3037db4c93', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-16038378', 'ctest-vn2-81919913'], 'port_security_enabled': True, 'description': ''}} 2025-08-13 14:51:45,704 - DEBUG - Response for create_subnet : {'subnet': {'id': '6ebe0b02-40a7-47e1-a25f-300f43ee8a12', 'name': '', 'tenant_id': 'aec4ef4318ff4dd287a75c3037db4c93', 'network_id': 'b02b719b-99d3-4886-beeb-b89d0a80bc20', 'ip_version': 4, 'cidr': '56.106.79.64/26', 'allocation_pools': [{'start': '56.106.79.66', 'end': '56.106.79.126'}], 'gateway_ip': '56.106.79.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '56.106.79.66', 'tags': [], 'project_id': 'aec4ef4318ff4dd287a75c3037db4c93'}} 2025-08-13 14:51:45,724 - INFO - Created VN ctest-vn2-81919913 2025-08-13 14:51:45,778 - DEBUG - VN ctest-vn2-81919913 UUID is b02b719b-99d3-4886-beeb-b89d0a80bc20 2025-08-13 14:51:46,035 - DEBUG - Services list from nova: [, , ] 2025-08-13 14:51:47,090 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3839-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3839-1) 2025-08-13 14:51:48,279 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3839-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3839-1) 2025-08-13 14:51:48,361 - INFO - Adding interface with subnet_id ea4b16e0-b197-45dd-a98a-7a0dd9d93752, port_id None to router e080bfab-7420-4179-b1a7-f7e2ccbadb6b 2025-08-13 14:51:48,658 - INFO - Waiting for VM ctest-vn1-vm1-25510135 to be up.. 2025-08-13 14:51:48,769 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-13 14:51:53,863 - DEBUG - VM is in ACTIVE state now 2025-08-13 14:51:53,863 - INFO - VM name : ctest-vn1-vm1-25510135 2025-08-13 14:51:53,951 - DEBUG - VM ctest-vn1-vm1-25510135 ID is 0088a712-3b9e-4cee-bea6-6d0126fca002 2025-08-13 14:51:53,975 - DEBUG - VM ctest-vn1-vm1-25510135 launched on Node cn-jenkins-deploy-platform-ansible-os-3839-1 2025-08-13 14:51:54,056 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/0088a712-3b9e-4cee-bea6-6d0126fca002 2025-08-13 14:51:54,378 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/0088a712-3b9e-4cee-bea6-6d0126fca002 2025-08-13 14:51:54,413 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/2cdf8c96-7590-41e7-a73f-1cc34a474b63 2025-08-13 14:51:57,673 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-13 14:51:57,673 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-25510135 failed! 2025-08-13 14:51:57,730 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-16038378:ctest-vn1-06980474 is 210.60.40.129 and allocation pool is NOT set 2025-08-13 14:51:59,791 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.95 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.64 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.642/3.296/4.950/1.654 ms') 2025-08-13 14:51:59,791 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-25510135 passed 2025-08-13 14:51:59,954 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-13 14:51:59,954 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-25510135, IP 210.60.40.131, Port 22 2025-08-13 14:52:00,123 - DEBUG - VM ctest-vn1-vm1-25510135 is ready for SSH connections 2025-08-13 14:52:00,123 - INFO - Waiting for VM ctest-vn2-vm1-20186463 to be up.. 2025-08-13 14:52:00,203 - DEBUG - VM is in ACTIVE state now 2025-08-13 14:52:00,203 - INFO - VM name : ctest-vn2-vm1-20186463 2025-08-13 14:52:00,278 - DEBUG - VM ctest-vn2-vm1-20186463 ID is 6db3578f-5b4e-4d30-959f-71d1e6a7fb5a 2025-08-13 14:52:00,278 - DEBUG - VM ctest-vn2-vm1-20186463 launched on Node cn-jenkins-deploy-platform-ansible-os-3839-1 2025-08-13 14:52:00,354 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/6db3578f-5b4e-4d30-959f-71d1e6a7fb5a 2025-08-13 14:52:00,371 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/69cec597-fed3-41e4-a138-6735bcc140d1 2025-08-13 14:52:01,662 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.70 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.45 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.451/3.075/4.699/1.624 ms') 2025-08-13 14:52:01,662 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn2-vm1-20186463 passed 2025-08-13 14:52:01,814 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-13 14:52:01,814 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-20186463, IP 56.106.79.67, Port 22 2025-08-13 14:52:01,973 - DEBUG - VM ctest-vn2-vm1-20186463 is ready for SSH connections 2025-08-13 14:52:01,974 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-13 14:52:01,974 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 56.106.79.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 14:52:01,974 - DEBUG - ping -s 56 -c 3 -W 1 56.106.79.67 2025-08-13 14:52:05,610 - DEBUG - PING 56.106.79.67 (56.106.79.67): 56 data bytes --- 56.106.79.67 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-13 14:52:05,610 - WARNING - Ping to IP 56.106.79.67 from VM ctest-vn1-vm1-25510135 failed 2025-08-13 14:52:05,610 - INFO - Adding interface with subnet_id 6ebe0b02-40a7-47e1-a25f-300f43ee8a12, port_id None to router e080bfab-7420-4179-b1a7-f7e2ccbadb6b 2025-08-13 14:52:05,950 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-13 14:52:05,950 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 56.106.79.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 14:52:05,950 - DEBUG - ping -s 56 -c 3 -W 1 56.106.79.67 2025-08-13 14:52:09,157 - DEBUG - PING 56.106.79.67 (56.106.79.67): 56 data bytes --- 56.106.79.67 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-13 14:52:09,157 - WARNING - Ping to IP 56.106.79.67 from VM ctest-vn1-vm1-25510135 failed 2025-08-13 14:52:10,158 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 56.106.79.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 14:52:10,158 - DEBUG - ping -s 56 -c 3 -W 1 56.106.79.67 2025-08-13 14:52:13,367 - DEBUG - PING 56.106.79.67 (56.106.79.67): 56 data bytes --- 56.106.79.67 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-13 14:52:13,368 - WARNING - Ping to IP 56.106.79.67 from VM ctest-vn1-vm1-25510135 failed 2025-08-13 14:52:14,369 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 56.106.79.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 14:52:14,369 - DEBUG - ping -s 56 -c 3 -W 1 56.106.79.67 2025-08-13 14:52:17,575 - DEBUG - PING 56.106.79.67 (56.106.79.67): 56 data bytes --- 56.106.79.67 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-13 14:52:17,575 - WARNING - Ping to IP 56.106.79.67 from VM ctest-vn1-vm1-25510135 failed 2025-08-13 14:52:18,576 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 56.106.79.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 14:52:18,576 - DEBUG - ping -s 56 -c 3 -W 1 56.106.79.67 2025-08-13 14:52:21,775 - DEBUG - PING 56.106.79.67 (56.106.79.67): 56 data bytes --- 56.106.79.67 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-13 14:52:21,775 - WARNING - Ping to IP 56.106.79.67 from VM ctest-vn1-vm1-25510135 failed 2025-08-13 14:52:22,776 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 56.106.79.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 14:52:22,776 - DEBUG - ping -s 56 -c 3 -W 1 56.106.79.67 2025-08-13 14:52:25,973 - DEBUG - PING 56.106.79.67 (56.106.79.67): 56 data bytes --- 56.106.79.67 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-13 14:52:25,973 - WARNING - Ping to IP 56.106.79.67 from VM ctest-vn1-vm1-25510135 failed 2025-08-13 14:52:26,974 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 56.106.79.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 14:52:26,974 - DEBUG - ping -s 56 -c 3 -W 1 56.106.79.67 2025-08-13 14:52:30,183 - DEBUG - PING 56.106.79.67 (56.106.79.67): 56 data bytes --- 56.106.79.67 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-13 14:52:30,183 - WARNING - Ping to IP 56.106.79.67 from VM ctest-vn1-vm1-25510135 failed 2025-08-13 14:52:31,184 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 56.106.79.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 14:52:31,184 - DEBUG - ping -s 56 -c 3 -W 1 56.106.79.67 2025-08-13 14:52:34,385 - DEBUG - PING 56.106.79.67 (56.106.79.67): 56 data bytes --- 56.106.79.67 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-13 14:52:34,385 - WARNING - Ping to IP 56.106.79.67 from VM ctest-vn1-vm1-25510135 failed 2025-08-13 14:52:35,386 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 56.106.79.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 14:52:35,386 - DEBUG - ping -s 56 -c 3 -W 1 56.106.79.67 2025-08-13 14:52:38,594 - DEBUG - PING 56.106.79.67 (56.106.79.67): 56 data bytes --- 56.106.79.67 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-13 14:52:38,595 - WARNING - Ping to IP 56.106.79.67 from VM ctest-vn1-vm1-25510135 failed 2025-08-13 14:52:39,595 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 56.106.79.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 14:52:39,595 - DEBUG - ping -s 56 -c 3 -W 1 56.106.79.67 2025-08-13 14:52:42,789 - DEBUG - PING 56.106.79.67 (56.106.79.67): 56 data bytes --- 56.106.79.67 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-13 14:52:42,789 - WARNING - Ping to IP 56.106.79.67 from VM ctest-vn1-vm1-25510135 failed 2025-08-13 14:52:43,789 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 56.106.79.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 14:52:43,790 - DEBUG - ping -s 56 -c 3 -W 1 56.106.79.67 2025-08-13 14:52:46,999 - DEBUG - PING 56.106.79.67 (56.106.79.67): 56 data bytes --- 56.106.79.67 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-13 14:52:46,999 - WARNING - Ping to IP 56.106.79.67 from VM ctest-vn1-vm1-25510135 failed 2025-08-13 14:52:48,000 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 56.106.79.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-08-13 14:52:48,000 - DEBUG - ping -s 56 -c 3 -W 1 56.106.79.67 2025-08-13 14:52:51,206 - DEBUG - PING 56.106.79.67 (56.106.79.67): 56 data bytes --- 56.106.79.67 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-13 14:52:51,206 - WARNING - Ping to IP 56.106.79.67 from VM ctest-vn1-vm1-25510135 failed 2025-08-13 14:52:51,207 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-13 14:52:51,208 - INFO - Deleting interface with subnet_id 6ebe0b02-40a7-47e1-a25f-300f43ee8a12, port_id None from router e080bfab-7420-4179-b1a7-f7e2ccbadb6b 2025-08-13 14:52:51,346 - INFO - Deleting interface with subnet_id ea4b16e0-b197-45dd-a98a-7a0dd9d93752, port_id None from router e080bfab-7420-4179-b1a7-f7e2ccbadb6b 2025-08-13 14:52:51,526 - INFO - Deleting VM ctest-vn2-vm1-20186463 2025-08-13 14:52:51,592 - INFO - Deleting VM ctest-vn1-vm1-25510135 2025-08-13 14:52:51,663 - INFO - Deleting VN ctest-vn2-81919913 2025-08-13 14:52:51,703 - DEBUG - VN b02b719b-99d3-4886-beeb-b89d0a80bc20 still in use: Unable to complete operation on network b02b719b-99d3-4886-beeb-b89d0a80bc20. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-6858e8d6-f196-43cf-9a2f-e52192490fa5'] 2025-08-13 14:52:51,703 - WARNING - Deleting VN ctest-vn2-81919913 failed..Will retry 2025-08-13 14:52:53,813 - DEBUG - Response for deleting network () 2025-08-13 14:52:53,813 - INFO - Deleting VN ctest-vn1-06980474 2025-08-13 14:52:53,907 - DEBUG - Response for deleting network () 2025-08-13 14:52:54,153 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Wed Aug 13 14:52:51 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/neutron/test_routers.py in test_basic_router_behavior(self=) 69 'One or more router port IPs are not gateway IPs'\ 70 'Router ports : %s' % (router_ports) 71 assert vn1_vm1_fixture.ping_with_certainty(vn2_vm1_fixture.vm_ip) 72 self.delete_vn_from_router(router_dict['id'], vn1_fixture) 73 assert vn1_vm1_fixture.ping_with_certainty(vn2_vm1_fixture.vm_ip, vn1_vm1_fixture = vn1_vm1_fixture.ping_with_certainty = .deco_retry..f_retry of > vn2_vm1_fixture = vn2_vm1_fixture.vm_ip = '56.106.79.67' AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/neutron/test_routers.py", line 71, in test_basic_router_behavior assert vn1_vm1_fixture.ping_with_certainty(vn2_vm1_fixture.vm_ip) AssertionError 2025-08-13 14:52:54,160 - DEBUG - No XMPP flaps were noticed during the test 2025-08-13 14:52:54,160 - INFO -
2025-08-13 14:52:54,160 - INFO - END TEST : test_basic_router_behavior : FAILED[0:01:10]
2025-08-13 14:52:54,160 - INFO - -------------------------------------------------------------------------------- 2025-08-13 14:52:54,837 - INFO - Deleted project: ctest-TestRouters-16038378, ID : aec4ef43-18ff-4dd2-87a7-5c3037db4c93