2026-02-23 21:47:19,395 - INFO - Domain Default found not creating 2026-02-23 21:47:19,617 - INFO - Project ctest-TestRouters-66933829 not found, creating it 2026-02-23 21:47:20,062 - INFO - Created Project:ctest-TestRouters-66933829, ID : 65aefe87-4233-4f54-99ce-0e93146914ed 2026-02-23 21:47:21,925 - INFO - ================================================================================ 2026-02-23 21:47:21,925 - INFO - STARTING TEST : test_basic_router_behavior 2026-02-23 21:47:21,925 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs Create a router Create 2 VNs, and a VM in each Add router port from each VN Ping between VMs 2026-02-23 21:47:22,178 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.17': '0'}} with 2026-02-23 21:47:22,178 - INFO - Initial checks done. Running the testcase now 2026-02-23 21:47:22,178 - INFO - 2026-02-23 21:47:22,712 - DEBUG - Response for create_network : {'network': {'id': 'f43d6eda-5f0b-4909-86b7-c7e63d612448', 'name': 'ctest-vn1-11456823', 'tenant_id': '65aefe8742334f5499ce0e93146914ed', 'project_id': '65aefe8742334f5499ce0e93146914ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-66933829', 'ctest-vn1-11456823'], 'port_security_enabled': True, 'description': ''}} 2026-02-23 21:47:22,896 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b43ccfd3-8040-45cb-8cba-7256d8d201d6', 'name': '', 'tenant_id': '65aefe8742334f5499ce0e93146914ed', 'network_id': 'f43d6eda-5f0b-4909-86b7-c7e63d612448', 'ip_version': 4, 'cidr': '182.117.37.0/26', 'allocation_pools': [{'start': '182.117.37.2', 'end': '182.117.37.62'}], 'gateway_ip': '182.117.37.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '182.117.37.2', 'tags': [], 'project_id': '65aefe8742334f5499ce0e93146914ed'}} 2026-02-23 21:47:22,912 - INFO - Created VN ctest-vn1-11456823 2026-02-23 21:47:22,964 - DEBUG - VN ctest-vn1-11456823 UUID is f43d6eda-5f0b-4909-86b7-c7e63d612448 2026-02-23 21:47:23,274 - DEBUG - Response for create_network : {'network': {'id': '697ea0ac-8da8-4c96-9fce-ce1b80950c40', 'name': 'ctest-vn2-06468653', 'tenant_id': '65aefe8742334f5499ce0e93146914ed', 'project_id': '65aefe8742334f5499ce0e93146914ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-66933829', 'ctest-vn2-06468653'], 'port_security_enabled': True, 'description': ''}} 2026-02-23 21:47:23,431 - DEBUG - Response for create_subnet : {'subnet': {'id': '5956f5a3-2394-4041-a7df-be8b072f0912', 'name': '', 'tenant_id': '65aefe8742334f5499ce0e93146914ed', 'network_id': '697ea0ac-8da8-4c96-9fce-ce1b80950c40', 'ip_version': 4, 'cidr': '107.28.7.0/26', 'allocation_pools': [{'start': '107.28.7.2', 'end': '107.28.7.62'}], 'gateway_ip': '107.28.7.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '107.28.7.2', 'tags': [], 'project_id': '65aefe8742334f5499ce0e93146914ed'}} 2026-02-23 21:47:23,446 - INFO - Created VN ctest-vn2-06468653 2026-02-23 21:47:23,496 - DEBUG - VN ctest-vn2-06468653 UUID is 697ea0ac-8da8-4c96-9fce-ce1b80950c40 2026-02-23 21:47:23,681 - DEBUG - Services list from nova: [, , ] 2026-02-23 21:47:24,659 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-5391-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-5391-1) 2026-02-23 21:47:25,837 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-5391-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-5391-1) 2026-02-23 21:47:25,890 - INFO - Adding interface with subnet_id b43ccfd3-8040-45cb-8cba-7256d8d201d6, port_id None to router 1924905b-0623-4200-a654-8d0f4e5c4e4e 2026-02-23 21:47:26,144 - INFO - Waiting for VM ctest-vn1-vm1-31832442 to be up.. 2026-02-23 21:47:26,228 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-02-23 21:47:31,298 - DEBUG - VM is in ACTIVE state now 2026-02-23 21:47:31,298 - INFO - VM name : ctest-vn1-vm1-31832442 2026-02-23 21:47:31,364 - DEBUG - VM ctest-vn1-vm1-31832442 ID is e1b28337-3bf8-4ff9-b2a1-94a1e3500587 2026-02-23 21:47:31,382 - DEBUG - VM ctest-vn1-vm1-31832442 launched on Node cn-jenkins-deploy-platform-ansible-os-5391-1 2026-02-23 21:47:31,444 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/e1b28337-3bf8-4ff9-b2a1-94a1e3500587 2026-02-23 21:47:31,734 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/e1b28337-3bf8-4ff9-b2a1-94a1e3500587 2026-02-23 21:47:31,763 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/2e09627c-963d-4db4-aa96-836c1847c16a 2026-02-23 21:47:35,023 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2026-02-23 21:47:35,023 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-31832442 failed! 2026-02-23 21:47:35,076 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-66933829:ctest-vn1-11456823 is 182.117.37.1 and allocation pool is NOT set 2026-02-23 21:47:37,140 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.52 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.90 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.902/3.210/4.518/1.308 ms') 2026-02-23 21:47:37,140 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-31832442 passed 2026-02-23 21:47:37,288 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-23 21:47:37,288 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-31832442, IP 182.117.37.3, Port 22 2026-02-23 21:47:37,443 - DEBUG - VM ctest-vn1-vm1-31832442 is ready for SSH connections 2026-02-23 21:47:37,444 - INFO - Waiting for VM ctest-vn2-vm1-45927790 to be up.. 2026-02-23 21:47:37,509 - DEBUG - VM is in ACTIVE state now 2026-02-23 21:47:37,510 - INFO - VM name : ctest-vn2-vm1-45927790 2026-02-23 21:47:37,574 - DEBUG - VM ctest-vn2-vm1-45927790 ID is a9462a58-e4c6-4538-bb8b-eb8906db6f07 2026-02-23 21:47:37,575 - DEBUG - VM ctest-vn2-vm1-45927790 launched on Node cn-jenkins-deploy-platform-ansible-os-5391-1 2026-02-23 21:47:37,634 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/a9462a58-e4c6-4538-bb8b-eb8906db6f07 2026-02-23 21:47:37,640 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/99fbb375-04ff-4442-b412-2881c3aaead3 2026-02-23 21:47:38,874 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.69 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.427 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.427/1.559/2.692/1.132 ms') 2026-02-23 21:47:38,874 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn2-vm1-45927790 passed 2026-02-23 21:47:39,024 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-23 21:47:39,024 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-45927790, IP 107.28.7.3, Port 22 2026-02-23 21:47:39,179 - DEBUG - VM ctest-vn2-vm1-45927790 is ready for SSH connections 2026-02-23 21:47:39,179 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-23 21:47:39,180 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 107.28.7.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-23 21:47:39,180 - DEBUG - ping -s 56 -c 3 -W 1 107.28.7.3 2026-02-23 21:47:43,836 - DEBUG - PING 107.28.7.3 (107.28.7.3): 56 data bytes --- 107.28.7.3 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2026-02-23 21:47:43,836 - WARNING - Ping to IP 107.28.7.3 from VM ctest-vn1-vm1-31832442 failed 2026-02-23 21:47:43,836 - INFO - Adding interface with subnet_id 5956f5a3-2394-4041-a7df-be8b072f0912, port_id None to router 1924905b-0623-4200-a654-8d0f4e5c4e4e 2026-02-23 21:47:44,045 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-23 21:47:44,045 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 107.28.7.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-23 21:47:44,045 - DEBUG - ping -s 56 -c 3 -W 1 107.28.7.3 2026-02-23 21:49:44,138 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1367, in ping_to_ip output = remote_cmd( File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1148, in sudo return _run_command( File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2026-02-23 21:49:45,140 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 107.28.7.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-23 21:49:45,141 - DEBUG - ping -s 56 -c 3 -W 1 107.28.7.3 2026-02-23 21:51:45,143 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1367, in ping_to_ip output = remote_cmd( File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1148, in sudo return _run_command( File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2026-02-23 21:51:46,144 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 107.28.7.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-23 21:51:46,144 - DEBUG - ping -s 56 -c 3 -W 1 107.28.7.3 2026-02-23 21:53:46,227 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1367, in ping_to_ip output = remote_cmd( File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1148, in sudo return _run_command( File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2026-02-23 21:53:47,228 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 107.28.7.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-23 21:53:47,228 - DEBUG - ping -s 56 -c 3 -W 1 107.28.7.3 2026-02-23 21:55:47,295 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1367, in ping_to_ip output = remote_cmd( File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1148, in sudo return _run_command( File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2026-02-23 21:55:48,296 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 107.28.7.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-23 21:55:48,296 - DEBUG - ping -s 56 -c 3 -W 1 107.28.7.3 2026-02-23 21:57:48,334 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1367, in ping_to_ip output = remote_cmd( File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1148, in sudo return _run_command( File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2026-02-23 21:57:49,335 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 107.28.7.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-23 21:57:49,335 - DEBUG - ping -s 56 -c 3 -W 1 107.28.7.3 2026-02-23 21:59:49,400 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1367, in ping_to_ip output = remote_cmd( File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1148, in sudo return _run_command( File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2026-02-23 21:59:50,402 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 107.28.7.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-23 21:59:50,402 - DEBUG - ping -s 56 -c 3 -W 1 107.28.7.3 2026-02-23 22:01:50,492 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1367, in ping_to_ip output = remote_cmd( File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1148, in sudo return _run_command( File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2026-02-23 22:01:51,492 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 107.28.7.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-23 22:01:51,493 - DEBUG - ping -s 56 -c 3 -W 1 107.28.7.3 2026-02-23 22:05:42,878 - DEBUG - None 2026-02-23 22:05:42,878 - WARNING - Got exception in ping_to_ip:argument of type 'NoneType' is not iterable 2026-02-23 22:05:43,879 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 107.28.7.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-23 22:05:43,879 - DEBUG - ping -s 56 -c 3 -W 1 107.28.7.3 2026-02-23 22:07:55,092 - ERROR - Unable to run command ping -s 56 -c 3 -W 1 107.28.7.3: ChannelException(2, 'Connect failed') Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 455, in connect sock = get_gateway(host, port, cache, replace=tries > 0) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 95, in get_gateway sock = direct_tcpip(dict.__getitem__(cache, gateway), host, port) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 38, in direct_tcpip return client.get_transport().open_channel( File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1061, in open_channel raise e paramiko.ssh_exception.ChannelException: ChannelException(2, 'Connect failed') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1148, in sudo return _run_command( File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 416, in _open_session transport = connections[env.host_string].get_transport() File "/contrail-test/tcutils/fabutils.py", line 47, in __getitem__ self.connect(key) File "/contrail-test/tcutils/fabutils.py", line 33, in connect self[key] = connect( File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 508, in connect raise NetworkError(msg, e) fabric.exceptions.NetworkError: ChannelException(2, 'Connect failed') 2026-02-23 22:08:00,094 - DEBUG - None 2026-02-23 22:08:00,094 - WARNING - Got exception in ping_to_ip:argument of type 'NoneType' is not iterable 2026-02-23 22:08:01,095 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 107.28.7.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-23 22:08:01,095 - DEBUG - ping -s 56 -c 3 -W 1 107.28.7.3 2026-02-23 22:10:12,308 - ERROR - Unable to run command ping -s 56 -c 3 -W 1 107.28.7.3: ChannelException(2, 'Connect failed') Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 455, in connect sock = get_gateway(host, port, cache, replace=tries > 0) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 95, in get_gateway sock = direct_tcpip(dict.__getitem__(cache, gateway), host, port) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 38, in direct_tcpip return client.get_transport().open_channel( File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1061, in open_channel raise e paramiko.ssh_exception.ChannelException: ChannelException(2, 'Connect failed') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1148, in sudo return _run_command( File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 416, in _open_session transport = connections[env.host_string].get_transport() File "/contrail-test/tcutils/fabutils.py", line 47, in __getitem__ self.connect(key) File "/contrail-test/tcutils/fabutils.py", line 33, in connect self[key] = connect( File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 508, in connect raise NetworkError(msg, e) fabric.exceptions.NetworkError: ChannelException(2, 'Connect failed') 2026-02-23 22:10:17,309 - DEBUG - None 2026-02-23 22:10:17,309 - WARNING - Got exception in ping_to_ip:argument of type 'NoneType' is not iterable 2026-02-23 22:10:18,310 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 107.28.7.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-23 22:10:18,310 - DEBUG - ping -s 56 -c 3 -W 1 107.28.7.3 2026-02-23 22:12:29,524 - ERROR - Unable to run command ping -s 56 -c 3 -W 1 107.28.7.3: ChannelException(2, 'Connect failed') Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 455, in connect sock = get_gateway(host, port, cache, replace=tries > 0) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 95, in get_gateway sock = direct_tcpip(dict.__getitem__(cache, gateway), host, port) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 38, in direct_tcpip return client.get_transport().open_channel( File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1061, in open_channel raise e paramiko.ssh_exception.ChannelException: ChannelException(2, 'Connect failed') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1148, in sudo return _run_command( File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 416, in _open_session transport = connections[env.host_string].get_transport() File "/contrail-test/tcutils/fabutils.py", line 47, in __getitem__ self.connect(key) File "/contrail-test/tcutils/fabutils.py", line 33, in connect self[key] = connect( File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 508, in connect raise NetworkError(msg, e) fabric.exceptions.NetworkError: ChannelException(2, 'Connect failed') 2026-02-23 22:12:34,525 - DEBUG - None 2026-02-23 22:12:34,525 - WARNING - Got exception in ping_to_ip:argument of type 'NoneType' is not iterable 2026-02-23 22:12:34,529 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-23 22:12:34,529 - INFO - Deleting interface with subnet_id 5956f5a3-2394-4041-a7df-be8b072f0912, port_id None from router 1924905b-0623-4200-a654-8d0f4e5c4e4e 2026-02-23 22:12:34,715 - INFO - Deleting interface with subnet_id b43ccfd3-8040-45cb-8cba-7256d8d201d6, port_id None from router 1924905b-0623-4200-a654-8d0f4e5c4e4e 2026-02-23 22:12:34,864 - INFO - Deleting VM ctest-vn2-vm1-45927790 2026-02-23 22:12:34,925 - INFO - Deleting VM ctest-vn1-vm1-31832442 2026-02-23 22:12:34,987 - INFO - Deleting VN ctest-vn2-06468653 2026-02-23 22:12:35,027 - DEBUG - VN 697ea0ac-8da8-4c96-9fce-ce1b80950c40 still in use: Unable to complete operation on network 697ea0ac-8da8-4c96-9fce-ce1b80950c40. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-3cbb5944-7ea5-4028-b477-dfb52c2ff457'] 2026-02-23 22:12:35,027 - WARNING - Deleting VN ctest-vn2-06468653 failed..Will retry 2026-02-23 22:12:37,148 - DEBUG - Response for deleting network () 2026-02-23 22:12:37,149 - INFO - Deleting VN ctest-vn1-11456823 2026-02-23 22:12:37,237 - DEBUG - Response for deleting network () 2026-02-23 22:12:37,488 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Mon Feb 23 22:12:34 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/neutron/test_routers.py in test_basic_router_behavior(self=) 69 'One or more router port IPs are not gateway IPs'\ 70 'Router ports : %s' % (router_ports) 71 assert vn1_vm1_fixture.ping_with_certainty(vn2_vm1_fixture.vm_ip) 72 self.delete_vn_from_router(router_dict['id'], vn1_fixture) 73 assert vn1_vm1_fixture.ping_with_certainty(vn2_vm1_fixture.vm_ip, vn1_vm1_fixture = vn1_vm1_fixture.ping_with_certainty = .deco_retry..f_retry of > vn2_vm1_fixture = vn2_vm1_fixture.vm_ip = '107.28.7.3' AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/neutron/test_routers.py", line 71, in test_basic_router_behavior assert vn1_vm1_fixture.ping_with_certainty(vn2_vm1_fixture.vm_ip) AssertionError 2026-02-23 22:12:37,493 - DEBUG - No XMPP flaps were noticed during the test 2026-02-23 22:12:37,493 - INFO -
2026-02-23 22:12:37,493 - INFO - END TEST : test_basic_router_behavior : FAILED[0:25:16]
2026-02-23 22:12:37,493 - INFO - -------------------------------------------------------------------------------- 2026-02-23 22:12:38,406 - INFO - Deleted project: ctest-TestRouters-66933829, ID : 65aefe87-4233-4f54-99ce-0e93146914ed