2026-01-05 02:20:00,647 - INFO - Domain Default found not creating 2026-01-05 02:20:00,842 - INFO - Project ctest-TestRouters-21792325 not found, creating it 2026-01-05 02:20:01,457 - INFO - Created Project:ctest-TestRouters-21792325, ID : 4e9403d7-6196-4fda-a5cf-f66d50e73164 2026-01-05 02:20:03,033 - INFO - ================================================================================ 2026-01-05 02:20:03,033 - INFO - STARTING TEST : test_basic_router_behavior 2026-01-05 02:20:03,033 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs Create a router Create 2 VNs, and a VM in each Add router port from each VN Ping between VMs 2026-01-05 02:20:04,331 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.25': '0', '10.20.0.129': '0'}, '10.0.0.56': {'10.20.0.254': '0', '10.20.0.129': '0'}} with 2026-01-05 02:20:04,332 - INFO - Initial checks done. Running the testcase now 2026-01-05 02:20:04,332 - INFO - 2026-01-05 02:20:05,072 - DEBUG - Response for create_network : {'network': {'id': '333f4573-aa22-4501-9491-eddfec10714e', 'name': 'ctest-vn1-15686570', 'tenant_id': '4e9403d761964fdaa5cff66d50e73164', 'project_id': '4e9403d761964fdaa5cff66d50e73164', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-21792325', 'ctest-vn1-15686570'], 'port_security_enabled': True, 'description': ''}} 2026-01-05 02:20:05,449 - DEBUG - Response for create_subnet : {'subnet': {'id': '37e614eb-6488-471a-85b0-57d6ae907030', 'name': '', 'tenant_id': '4e9403d761964fdaa5cff66d50e73164', 'network_id': '333f4573-aa22-4501-9491-eddfec10714e', 'ip_version': 4, 'cidr': '110.173.165.128/26', 'allocation_pools': [{'start': '110.173.165.130', 'end': '110.173.165.190'}], 'gateway_ip': '110.173.165.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '110.173.165.130', 'tags': [], 'project_id': '4e9403d761964fdaa5cff66d50e73164'}} 2026-01-05 02:20:05,481 - INFO - Created VN ctest-vn1-15686570 2026-01-05 02:20:05,496 - DEBUG - VN ctest-vn1-15686570 UUID is 333f4573-aa22-4501-9491-eddfec10714e 2026-01-05 02:20:05,858 - DEBUG - Response for create_network : {'network': {'id': 'e353ff01-4c23-42d1-96e3-7995556398fe', 'name': 'ctest-vn2-56707206', 'tenant_id': '4e9403d761964fdaa5cff66d50e73164', 'project_id': '4e9403d761964fdaa5cff66d50e73164', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-21792325', 'ctest-vn2-56707206'], 'port_security_enabled': True, 'description': ''}} 2026-01-05 02:20:06,107 - DEBUG - Response for create_subnet : {'subnet': {'id': '6dd016ca-b25f-4a7a-aa81-2c56d3085fa9', 'name': '', 'tenant_id': '4e9403d761964fdaa5cff66d50e73164', 'network_id': 'e353ff01-4c23-42d1-96e3-7995556398fe', 'ip_version': 4, 'cidr': '142.226.210.0/26', 'allocation_pools': [{'start': '142.226.210.2', 'end': '142.226.210.62'}], 'gateway_ip': '142.226.210.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '142.226.210.2', 'tags': [], 'project_id': '4e9403d761964fdaa5cff66d50e73164'}} 2026-01-05 02:20:06,133 - INFO - Created VN ctest-vn2-56707206 2026-01-05 02:20:06,145 - DEBUG - VN ctest-vn2-56707206 UUID is e353ff01-4c23-42d1-96e3-7995556398fe 2026-01-05 02:20:06,299 - DEBUG - Services list from nova: [, , , ] 2026-01-05 02:20:07,307 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4961-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4961-2) 2026-01-05 02:20:08,708 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4961-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4961-1) 2026-01-05 02:20:08,866 - INFO - Adding interface with subnet_id 37e614eb-6488-471a-85b0-57d6ae907030, port_id None to router 25472aee-186a-4f0b-9b68-eb8ad046a45e 2026-01-05 02:20:09,305 - INFO - Waiting for VM ctest-vn1-vm1-98631554 to be up.. 2026-01-05 02:20:09,479 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-01-05 02:20:14,561 - DEBUG - VM is in ACTIVE state now 2026-01-05 02:20:14,561 - INFO - VM name : ctest-vn1-vm1-98631554 2026-01-05 02:20:14,647 - DEBUG - VM ctest-vn1-vm1-98631554 ID is df236523-46f6-488e-abe1-bf6fa2a9c972 2026-01-05 02:20:14,679 - DEBUG - VM ctest-vn1-vm1-98631554 launched on Node an-jenkins-deploy-platform-ansible-os-4961-2 2026-01-05 02:20:14,786 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/df236523-46f6-488e-abe1-bf6fa2a9c972 2026-01-05 02:20:15,063 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/df236523-46f6-488e-abe1-bf6fa2a9c972 2026-01-05 02:20:15,103 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/38e48bc6-42fa-405a-a5f3-1fcde8b37d21 2026-01-05 02:20:18,281 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2026-01-05 02:20:18,281 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-98631554 failed! 2026-01-05 02:20:18,296 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-21792325:ctest-vn1-15686570 is 110.173.165.129 and allocation pool is NOT set 2026-01-05 02:20:20,368 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.84 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.57 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.565/4.704/6.844/2.139 ms') 2026-01-05 02:20:20,368 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-98631554 passed 2026-01-05 02:20:20,438 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-05 02:20:20,439 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-98631554, IP 110.173.165.131, Port 22 2026-01-05 02:20:20,507 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-05 02:20:20,591 - DEBUG - VM ctest-vn1-vm1-98631554 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-05 02:20:25,592 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-05 02:20:25,592 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-98631554, IP 110.173.165.131, Port 22 2026-01-05 02:20:25,749 - DEBUG - VM ctest-vn1-vm1-98631554 is ready for SSH connections 2026-01-05 02:20:25,749 - INFO - Waiting for VM ctest-vn2-vm1-66149495 to be up.. 2026-01-05 02:20:25,836 - DEBUG - VM is in ACTIVE state now 2026-01-05 02:20:25,836 - INFO - VM name : ctest-vn2-vm1-66149495 2026-01-05 02:20:25,922 - DEBUG - VM ctest-vn2-vm1-66149495 ID is ecbacd97-217e-4308-a382-3c7924edde16 2026-01-05 02:20:25,922 - DEBUG - VM ctest-vn2-vm1-66149495 launched on Node an-jenkins-deploy-platform-ansible-os-4961-1 2026-01-05 02:20:26,019 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/ecbacd97-217e-4308-a382-3c7924edde16 2026-01-05 02:20:26,030 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/d6b65424-c560-462b-bf30-eda58207caf6 2026-01-05 02:20:27,194 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.90 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.434 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.434/1.664/2.895/1.230 ms') 2026-01-05 02:20:27,194 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2-vm1-66149495 passed 2026-01-05 02:20:27,262 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-05 02:20:27,263 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-66149495, IP 142.226.210.3, Port 22 2026-01-05 02:20:27,419 - DEBUG - VM ctest-vn2-vm1-66149495 is ready for SSH connections 2026-01-05 02:20:27,419 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-05 02:20:27,420 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 142.226.210.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.56, gateway password: c0ntrail123 2026-01-05 02:20:27,420 - DEBUG - ping -s 56 -c 3 -W 1 142.226.210.3 2026-01-05 02:20:31,430 - DEBUG - PING 142.226.210.3 (142.226.210.3): 56 data bytes --- 142.226.210.3 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2026-01-05 02:20:31,430 - WARNING - Ping to IP 142.226.210.3 from VM ctest-vn1-vm1-98631554 failed 2026-01-05 02:20:31,430 - INFO - Adding interface with subnet_id 6dd016ca-b25f-4a7a-aa81-2c56d3085fa9, port_id None to router 25472aee-186a-4f0b-9b68-eb8ad046a45e 2026-01-05 02:20:31,861 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-05 02:20:31,862 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 142.226.210.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.56, gateway password: c0ntrail123 2026-01-05 02:20:31,862 - DEBUG - ping -s 56 -c 3 -W 1 142.226.210.3 2026-01-05 02:20:35,072 - DEBUG - PING 142.226.210.3 (142.226.210.3): 56 data bytes 64 bytes from 142.226.210.3: seq=1 ttl=63 time=7.352 ms 64 bytes from 142.226.210.3: seq=2 ttl=63 time=1.846 ms --- 142.226.210.3 ping statistics --- 3 packets transmitted, 2 packets received, 33% packet loss round-trip min/avg/max = 1.846/4.599/7.352 ms 2026-01-05 02:20:35,072 - WARNING - Ping to IP 142.226.210.3 from VM ctest-vn1-vm1-98631554 failed 2026-01-05 02:20:36,073 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 142.226.210.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.56, gateway password: c0ntrail123 2026-01-05 02:20:36,073 - DEBUG - ping -s 56 -c 3 -W 1 142.226.210.3 2026-01-05 02:20:38,278 - DEBUG - PING 142.226.210.3 (142.226.210.3): 56 data bytes 64 bytes from 142.226.210.3: seq=0 ttl=63 time=3.779 ms 64 bytes from 142.226.210.3: seq=1 ttl=63 time=1.141 ms 64 bytes from 142.226.210.3: seq=2 ttl=63 time=1.415 ms --- 142.226.210.3 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.141/2.111/3.779 ms 2026-01-05 02:20:38,279 - INFO - Ping to IP 142.226.210.3 from VM ctest-vn1-vm1-98631554 passed 2026-01-05 02:20:38,279 - INFO - Deleting interface with subnet_id 37e614eb-6488-471a-85b0-57d6ae907030, port_id None from router 25472aee-186a-4f0b-9b68-eb8ad046a45e 2026-01-05 02:20:38,504 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-05 02:20:38,504 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 142.226.210.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.56, gateway password: c0ntrail123 2026-01-05 02:20:38,504 - DEBUG - ping -s 56 -c 3 -W 1 142.226.210.3 2026-01-05 02:20:41,707 - DEBUG - PING 142.226.210.3 (142.226.210.3): 56 data bytes --- 142.226.210.3 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2026-01-05 02:20:41,707 - WARNING - Ping to IP 142.226.210.3 from VM ctest-vn1-vm1-98631554 failed 2026-01-05 02:20:41,707 - INFO - Adding interface with subnet_id 37e614eb-6488-471a-85b0-57d6ae907030, port_id None to router 25472aee-186a-4f0b-9b68-eb8ad046a45e 2026-01-05 02:20:42,053 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-05 02:20:42,053 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 142.226.210.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.56, gateway password: c0ntrail123 2026-01-05 02:20:42,054 - DEBUG - ping -s 56 -c 3 -W 1 142.226.210.3 2026-01-05 02:20:44,273 - DEBUG - PING 142.226.210.3 (142.226.210.3): 56 data bytes 64 bytes from 142.226.210.3: seq=0 ttl=63 time=2.098 ms 64 bytes from 142.226.210.3: seq=1 ttl=63 time=1.404 ms 64 bytes from 142.226.210.3: seq=2 ttl=63 time=1.258 ms --- 142.226.210.3 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.258/1.586/2.098 ms 2026-01-05 02:20:44,274 - INFO - Ping to IP 142.226.210.3 from VM ctest-vn1-vm1-98631554 passed 2026-01-05 02:20:44,274 - INFO - Deleting interface with subnet_id 6dd016ca-b25f-4a7a-aa81-2c56d3085fa9, port_id None from router 25472aee-186a-4f0b-9b68-eb8ad046a45e 2026-01-05 02:20:44,471 - INFO - Deleting interface with subnet_id 37e614eb-6488-471a-85b0-57d6ae907030, port_id None from router 25472aee-186a-4f0b-9b68-eb8ad046a45e 2026-01-05 02:20:44,770 - INFO - Deleting VM ctest-vn2-vm1-66149495 2026-01-05 02:20:44,859 - INFO - Deleting VM ctest-vn1-vm1-98631554 2026-01-05 02:20:44,928 - INFO - Deleting VN ctest-vn2-56707206 2026-01-05 02:20:44,968 - DEBUG - VN e353ff01-4c23-42d1-96e3-7995556398fe still in use: Unable to complete operation on network e353ff01-4c23-42d1-96e3-7995556398fe. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1d46e73a-9b7b-40c3-889b-3a7ef7c96db2'] 2026-01-05 02:20:44,968 - WARNING - Deleting VN ctest-vn2-56707206 failed..Will retry 2026-01-05 02:20:47,116 - DEBUG - Response for deleting network () 2026-01-05 02:20:47,116 - INFO - Deleting VN ctest-vn1-15686570 2026-01-05 02:20:47,278 - DEBUG - Response for deleting network () 2026-01-05 02:20:48,574 - DEBUG - No XMPP flaps were noticed during the test 2026-01-05 02:20:48,574 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:45] 2026-01-05 02:20:48,575 - INFO - -------------------------------------------------------------------------------- 2026-01-05 02:20:49,360 - INFO - Deleted project: ctest-TestRouters-21792325, ID : 4e9403d7-6196-4fda-a5cf-f66d50e73164