2026-03-12 02:19:02,301 - INFO - Domain Default found not creating
2026-03-12 02:19:02,469 - INFO - Project ctest-TestRouters-15869634 not found, creating it
2026-03-12 02:19:03,009 - INFO - Created Project:ctest-TestRouters-15869634, ID : 97b28059-dc29-40cf-9df0-b4fc2e2db729
2026-03-12 02:19:04,469 - INFO - ================================================================================
2026-03-12 02:19:04,469 - INFO - STARTING TEST : test_basic_router_behavior
2026-03-12 02:19:04,469 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
Create a router
Create 2 VNs, and a VM in each
Add router port from each VN
Ping between VMs
2026-03-12 02:19:05,746 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.17': '0', '10.20.0.129': '0'}, '10.0.0.133': {'10.20.0.17': '0', '10.20.0.129': '0'}} with
2026-03-12 02:19:05,746 - INFO - Initial checks done. Running the testcase now
2026-03-12 02:19:05,747 - INFO -
2026-03-12 02:19:06,422 - DEBUG - Response for create_network : {'network': {'id': '0b4c6546-b531-438d-9238-c5243597fd5a', 'name': 'ctest-vn1-29267309', 'tenant_id': '97b28059dc2940cf9df0b4fc2e2db729', 'project_id': '97b28059dc2940cf9df0b4fc2e2db729', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-15869634', 'ctest-vn1-29267309'], 'port_security_enabled': True, 'description': ''}}
2026-03-12 02:19:06,753 - DEBUG - Response for create_subnet : {'subnet': {'id': 'aeb77a12-d370-465c-80d5-59669ef97773', 'name': '', 'tenant_id': '97b28059dc2940cf9df0b4fc2e2db729', 'network_id': '0b4c6546-b531-438d-9238-c5243597fd5a', 'ip_version': 4, 'cidr': '84.64.193.0/26', 'allocation_pools': [{'start': '84.64.193.2', 'end': '84.64.193.62'}], 'gateway_ip': '84.64.193.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '84.64.193.2', 'tags': [], 'project_id': '97b28059dc2940cf9df0b4fc2e2db729'}}
2026-03-12 02:19:06,778 - INFO - Created VN ctest-vn1-29267309
2026-03-12 02:19:06,789 - DEBUG - VN ctest-vn1-29267309 UUID is 0b4c6546-b531-438d-9238-c5243597fd5a
2026-03-12 02:19:07,247 - DEBUG - Response for create_network : {'network': {'id': 'e98c32cd-f344-419b-844d-e81de1c2fc9c', 'name': 'ctest-vn2-36232992', 'tenant_id': '97b28059dc2940cf9df0b4fc2e2db729', 'project_id': '97b28059dc2940cf9df0b4fc2e2db729', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-15869634', 'ctest-vn2-36232992'], 'port_security_enabled': True, 'description': ''}}
2026-03-12 02:19:07,494 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ba617b59-9c78-4bee-866c-d27d2ee2919e', 'name': '', 'tenant_id': '97b28059dc2940cf9df0b4fc2e2db729', 'network_id': 'e98c32cd-f344-419b-844d-e81de1c2fc9c', 'ip_version': 4, 'cidr': '48.232.187.0/26', 'allocation_pools': [{'start': '48.232.187.2', 'end': '48.232.187.62'}], 'gateway_ip': '48.232.187.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '48.232.187.2', 'tags': [], 'project_id': '97b28059dc2940cf9df0b4fc2e2db729'}}
2026-03-12 02:19:07,517 - INFO - Created VN ctest-vn2-36232992
2026-03-12 02:19:07,534 - DEBUG - VN ctest-vn2-36232992 UUID is e98c32cd-f344-419b-844d-e81de1c2fc9c
2026-03-12 02:19:07,680 - DEBUG - Services list from nova: [, , , ]
2026-03-12 02:19:09,418 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5460-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5460-2)
2026-03-12 02:19:11,177 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5460-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5460-1)
2026-03-12 02:19:11,281 - INFO - Adding interface with subnet_id aeb77a12-d370-465c-80d5-59669ef97773, port_id None to router c93b8429-45b8-4cb0-aa3c-a5d17d368ebb
2026-03-12 02:19:11,638 - INFO - Waiting for VM ctest-vn1-vm1-16518079 to be up..
2026-03-12 02:19:11,764 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-12 02:19:16,849 - DEBUG - VM is in ACTIVE state now
2026-03-12 02:19:16,849 - INFO - VM name : ctest-vn1-vm1-16518079
2026-03-12 02:19:16,929 - DEBUG - VM ctest-vn1-vm1-16518079 ID is ef605520-6ea0-48e6-adb8-94d6dca6a4d4
2026-03-12 02:19:16,959 - DEBUG - VM ctest-vn1-vm1-16518079 launched on Node an-jenkins-deploy-platform-ansible-os-5460-2
2026-03-12 02:19:17,037 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/ef605520-6ea0-48e6-adb8-94d6dca6a4d4
2026-03-12 02:19:17,334 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/ef605520-6ea0-48e6-adb8-94d6dca6a4d4
2026-03-12 02:19:17,366 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/d170ed9f-6212-474f-98fb-e35f8bbfaa09
2026-03-12 02:19:20,524 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms')
2026-03-12 02:19:20,524 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-16518079 failed!
2026-03-12 02:19:20,539 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-15869634:ctest-vn1-29267309 is 84.64.193.1 and allocation pool is NOT set
2026-03-12 02:19:22,611 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.84 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.468 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.468/3.656/6.844/3.188 ms')
2026-03-12 02:19:22,611 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-16518079 passed
2026-03-12 02:19:22,682 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-12 02:19:22,682 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-16518079, IP 84.64.193.3, Port 22
2026-03-12 02:19:22,853 - DEBUG - VM ctest-vn1-vm1-16518079 is ready for SSH connections
2026-03-12 02:19:22,853 - INFO - Waiting for VM ctest-vn2-vm1-83905919 to be up..
2026-03-12 02:19:22,939 - DEBUG - VM is in ACTIVE state now
2026-03-12 02:19:22,940 - INFO - VM name : ctest-vn2-vm1-83905919
2026-03-12 02:19:23,021 - DEBUG - VM ctest-vn2-vm1-83905919 ID is 1cd7634e-0cc4-48d9-832c-3d79a62bd82a
2026-03-12 02:19:23,021 - DEBUG - VM ctest-vn2-vm1-83905919 launched on Node an-jenkins-deploy-platform-ansible-os-5460-1
2026-03-12 02:19:23,096 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/1cd7634e-0cc4-48d9-832c-3d79a62bd82a
2026-03-12 02:19:23,107 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/3b50d766-e0a7-4f15-9c47-87b045a4d2ac
2026-03-12 02:19:24,266 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=10.8 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.91 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.907/6.856/10.805/3.949 ms')
2026-03-12 02:19:24,266 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2-vm1-83905919 passed
2026-03-12 02:19:24,337 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-12 02:19:24,337 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-83905919, IP 48.232.187.3, Port 22
2026-03-12 02:19:24,401 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-12 02:19:24,481 - DEBUG - VM ctest-vn2-vm1-83905919 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-12 02:19:29,481 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-12 02:19:29,482 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-83905919, IP 48.232.187.3, Port 22
2026-03-12 02:19:29,658 - DEBUG - VM ctest-vn2-vm1-83905919 is ready for SSH connections
2026-03-12 02:19:29,658 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-12 02:19:29,658 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 48.232.187.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.133, gateway password: c0ntrail123
2026-03-12 02:19:29,658 - DEBUG - ping -s 56 -c 3 -W 1 48.232.187.3
2026-03-12 02:19:33,593 - DEBUG - PING 48.232.187.3 (48.232.187.3): 56 data bytes
--- 48.232.187.3 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-03-12 02:19:33,593 - WARNING - Ping to IP 48.232.187.3 from VM ctest-vn1-vm1-16518079 failed
2026-03-12 02:19:33,593 - INFO - Adding interface with subnet_id ba617b59-9c78-4bee-866c-d27d2ee2919e, port_id None to router c93b8429-45b8-4cb0-aa3c-a5d17d368ebb
2026-03-12 02:19:33,966 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-12 02:19:33,966 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 48.232.187.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.133, gateway password: c0ntrail123
2026-03-12 02:19:33,967 - DEBUG - ping -s 56 -c 3 -W 1 48.232.187.3
2026-03-12 02:19:37,234 - DEBUG - PING 48.232.187.3 (48.232.187.3): 56 data bytes
64 bytes from 48.232.187.3: seq=1 ttl=63 time=6.267 ms
64 bytes from 48.232.187.3: seq=2 ttl=63 time=1.239 ms
--- 48.232.187.3 ping statistics ---
3 packets transmitted, 2 packets received, 33% packet loss
round-trip min/avg/max = 1.239/3.753/6.267 ms
2026-03-12 02:19:37,234 - WARNING - Ping to IP 48.232.187.3 from VM ctest-vn1-vm1-16518079 failed
2026-03-12 02:19:38,235 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 48.232.187.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.133, gateway password: c0ntrail123
2026-03-12 02:19:38,235 - DEBUG - ping -s 56 -c 3 -W 1 48.232.187.3
2026-03-12 02:19:40,437 - DEBUG - PING 48.232.187.3 (48.232.187.3): 56 data bytes
64 bytes from 48.232.187.3: seq=0 ttl=63 time=2.893 ms
64 bytes from 48.232.187.3: seq=1 ttl=63 time=1.595 ms
64 bytes from 48.232.187.3: seq=2 ttl=63 time=1.221 ms
--- 48.232.187.3 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.221/1.903/2.893 ms
2026-03-12 02:19:40,438 - INFO - Ping to IP 48.232.187.3 from VM ctest-vn1-vm1-16518079 passed
2026-03-12 02:19:40,438 - INFO - Deleting interface with subnet_id aeb77a12-d370-465c-80d5-59669ef97773, port_id None from router c93b8429-45b8-4cb0-aa3c-a5d17d368ebb
2026-03-12 02:19:40,686 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-12 02:19:40,686 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 48.232.187.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.133, gateway password: c0ntrail123
2026-03-12 02:19:40,686 - DEBUG - ping -s 56 -c 3 -W 1 48.232.187.3
2026-03-12 02:19:43,896 - DEBUG - PING 48.232.187.3 (48.232.187.3): 56 data bytes
--- 48.232.187.3 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-03-12 02:19:43,896 - WARNING - Ping to IP 48.232.187.3 from VM ctest-vn1-vm1-16518079 failed
2026-03-12 02:19:43,897 - INFO - Adding interface with subnet_id aeb77a12-d370-465c-80d5-59669ef97773, port_id None to router c93b8429-45b8-4cb0-aa3c-a5d17d368ebb
2026-03-12 02:19:44,258 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-12 02:19:44,258 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 48.232.187.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.133, gateway password: c0ntrail123
2026-03-12 02:19:44,258 - DEBUG - ping -s 56 -c 3 -W 1 48.232.187.3
2026-03-12 02:19:46,486 - DEBUG - PING 48.232.187.3 (48.232.187.3): 56 data bytes
64 bytes from 48.232.187.3: seq=0 ttl=63 time=2.643 ms
64 bytes from 48.232.187.3: seq=1 ttl=63 time=1.390 ms
64 bytes from 48.232.187.3: seq=2 ttl=63 time=1.309 ms
--- 48.232.187.3 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.309/1.780/2.643 ms
2026-03-12 02:19:46,486 - INFO - Ping to IP 48.232.187.3 from VM ctest-vn1-vm1-16518079 passed
2026-03-12 02:19:46,486 - INFO - Deleting interface with subnet_id ba617b59-9c78-4bee-866c-d27d2ee2919e, port_id None from router c93b8429-45b8-4cb0-aa3c-a5d17d368ebb
2026-03-12 02:19:46,794 - INFO - Deleting interface with subnet_id aeb77a12-d370-465c-80d5-59669ef97773, port_id None from router c93b8429-45b8-4cb0-aa3c-a5d17d368ebb
2026-03-12 02:19:47,190 - INFO - Deleting VM ctest-vn2-vm1-83905919
2026-03-12 02:19:47,291 - INFO - Deleting VM ctest-vn1-vm1-16518079
2026-03-12 02:19:47,365 - INFO - Deleting VN ctest-vn2-36232992
2026-03-12 02:19:47,432 - DEBUG - VN e98c32cd-f344-419b-844d-e81de1c2fc9c still in use: Unable to complete operation on network e98c32cd-f344-419b-844d-e81de1c2fc9c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-7615942d-e241-4e9d-b1c4-4d1593afb6c9']
2026-03-12 02:19:47,432 - WARNING - Deleting VN ctest-vn2-36232992 failed..Will retry
2026-03-12 02:19:49,618 - DEBUG - Response for deleting network ()
2026-03-12 02:19:49,619 - INFO - Deleting VN ctest-vn1-29267309
2026-03-12 02:19:49,810 - DEBUG - Response for deleting network ()
2026-03-12 02:19:51,107 - DEBUG - No XMPP flaps were noticed during the test
2026-03-12 02:19:51,107 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:47]
2026-03-12 02:19:51,107 - INFO - --------------------------------------------------------------------------------
2026-03-12 02:19:51,841 - INFO - Deleted project: ctest-TestRouters-15869634, ID : 97b28059-dc29-40cf-9df0-b4fc2e2db729