2026-02-05 02:23:58,988 - INFO - Domain Default found not creating
2026-02-05 02:23:59,184 - INFO - Project ctest-TestRouters-24324101 not found, creating it
2026-02-05 02:23:59,707 - INFO - Created Project:ctest-TestRouters-24324101, ID : ccbae010-1683-4e4a-b9d0-449a5783e206
2026-02-05 02:24:01,447 - INFO - ================================================================================
2026-02-05 02:24:01,448 - INFO - STARTING TEST : test_basic_router_behavior
2026-02-05 02:24:01,449 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
Create a router
Create 2 VNs, and a VM in each
Add router port from each VN
Ping between VMs
2026-02-05 02:24:02,732 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.192': '0', '10.20.0.193': '0'}, '10.0.0.65': {'10.20.0.192': '0', '10.20.0.209': '0'}} with
2026-02-05 02:24:02,732 - INFO - Initial checks done. Running the testcase now
2026-02-05 02:24:02,732 - INFO -
2026-02-05 02:24:03,475 - DEBUG - Response for create_network : {'network': {'id': 'bcbe5ca1-dc7b-4719-844f-61bc84e23925', 'name': 'ctest-vn1-47827337', 'tenant_id': 'ccbae01016834e4ab9d0449a5783e206', 'project_id': 'ccbae01016834e4ab9d0449a5783e206', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-24324101', 'ctest-vn1-47827337'], 'port_security_enabled': True, 'description': ''}}
2026-02-05 02:24:03,858 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a2e2866f-ea5f-4fe5-b77f-60ee0b05a316', 'name': '', 'tenant_id': 'ccbae01016834e4ab9d0449a5783e206', 'network_id': 'bcbe5ca1-dc7b-4719-844f-61bc84e23925', 'ip_version': 4, 'cidr': '5.87.17.64/26', 'allocation_pools': [{'start': '5.87.17.66', 'end': '5.87.17.126'}], 'gateway_ip': '5.87.17.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '5.87.17.66', 'tags': [], 'project_id': 'ccbae01016834e4ab9d0449a5783e206'}}
2026-02-05 02:24:03,891 - INFO - Created VN ctest-vn1-47827337
2026-02-05 02:24:03,907 - DEBUG - VN ctest-vn1-47827337 UUID is bcbe5ca1-dc7b-4719-844f-61bc84e23925
2026-02-05 02:24:04,319 - DEBUG - Response for create_network : {'network': {'id': 'fa722311-7a0b-4f03-be79-a64a0fbdedf7', 'name': 'ctest-vn2-86793048', 'tenant_id': 'ccbae01016834e4ab9d0449a5783e206', 'project_id': 'ccbae01016834e4ab9d0449a5783e206', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-24324101', 'ctest-vn2-86793048'], 'port_security_enabled': True, 'description': ''}}
2026-02-05 02:24:04,623 - DEBUG - Response for create_subnet : {'subnet': {'id': '27cafac8-fb6f-4399-b715-dda441119fd8', 'name': '', 'tenant_id': 'ccbae01016834e4ab9d0449a5783e206', 'network_id': 'fa722311-7a0b-4f03-be79-a64a0fbdedf7', 'ip_version': 4, 'cidr': '108.189.36.0/26', 'allocation_pools': [{'start': '108.189.36.2', 'end': '108.189.36.62'}], 'gateway_ip': '108.189.36.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '108.189.36.2', 'tags': [], 'project_id': 'ccbae01016834e4ab9d0449a5783e206'}}
2026-02-05 02:24:04,655 - INFO - Created VN ctest-vn2-86793048
2026-02-05 02:24:04,668 - DEBUG - VN ctest-vn2-86793048 UUID is fa722311-7a0b-4f03-be79-a64a0fbdedf7
2026-02-05 02:24:04,820 - DEBUG - Services list from nova: [, , , ]
2026-02-05 02:24:05,987 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5215-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5215-1)
2026-02-05 02:24:07,615 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5215-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5215-2)
2026-02-05 02:24:07,736 - INFO - Adding interface with subnet_id a2e2866f-ea5f-4fe5-b77f-60ee0b05a316, port_id None to router 8e07fbb0-2645-488f-9d62-262d970cfa38
2026-02-05 02:24:08,068 - INFO - Waiting for VM ctest-vn1-vm1-29465033 to be up..
2026-02-05 02:24:08,207 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-02-05 02:24:13,316 - DEBUG - VM is in ACTIVE state now
2026-02-05 02:24:13,316 - INFO - VM name : ctest-vn1-vm1-29465033
2026-02-05 02:24:13,409 - DEBUG - VM ctest-vn1-vm1-29465033 ID is 3b5bc326-b10b-430e-8f0f-8aa344ce286a
2026-02-05 02:24:13,446 - DEBUG - VM ctest-vn1-vm1-29465033 launched on Node an-jenkins-deploy-platform-ansible-os-5215-1
2026-02-05 02:24:13,564 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/3b5bc326-b10b-430e-8f0f-8aa344ce286a
2026-02-05 02:24:14,036 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/3b5bc326-b10b-430e-8f0f-8aa344ce286a
2026-02-05 02:24:14,091 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/842d42ab-84ef-45c9-a9f4-5e091a7a0be5
2026-02-05 02:24:17,281 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms')
2026-02-05 02:24:17,281 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-29465033 failed!
2026-02-05 02:24:17,296 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-24324101:ctest-vn1-47827337 is 5.87.17.65 and allocation pool is NOT set
2026-02-05 02:24:21,377 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=7.87 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1010ms\r\nrtt min/avg/max/mdev = 7.874/7.874/7.874/0.000 ms')
2026-02-05 02:24:21,377 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-29465033 passed
2026-02-05 02:24:21,447 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-05 02:24:21,448 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-29465033, IP 5.87.17.67, Port 22
2026-02-05 02:24:21,513 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-02-05 02:24:21,607 - DEBUG - VM ctest-vn1-vm1-29465033 is NOT ready for SSH connections, VM status: ACTIVE
2026-02-05 02:24:26,608 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-05 02:24:26,608 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-29465033, IP 5.87.17.67, Port 22
2026-02-05 02:24:26,782 - DEBUG - VM ctest-vn1-vm1-29465033 is ready for SSH connections
2026-02-05 02:24:26,782 - INFO - Waiting for VM ctest-vn2-vm1-13335895 to be up..
2026-02-05 02:24:26,879 - DEBUG - VM is in ACTIVE state now
2026-02-05 02:24:26,879 - INFO - VM name : ctest-vn2-vm1-13335895
2026-02-05 02:24:26,965 - DEBUG - VM ctest-vn2-vm1-13335895 ID is 3edda56f-9534-4a07-9f27-6c67fabc44bb
2026-02-05 02:24:26,965 - DEBUG - VM ctest-vn2-vm1-13335895 launched on Node an-jenkins-deploy-platform-ansible-os-5215-2
2026-02-05 02:24:27,078 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/3edda56f-9534-4a07-9f27-6c67fabc44bb
2026-02-05 02:24:27,091 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/87eaa64c-52f2-431b-b430-8a5713633311
2026-02-05 02:24:28,267 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.82 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.384 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.384/1.602/2.821/1.218 ms')
2026-02-05 02:24:28,268 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2-vm1-13335895 passed
2026-02-05 02:24:28,342 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-05 02:24:28,343 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-13335895, IP 108.189.36.3, Port 22
2026-02-05 02:24:28,519 - DEBUG - VM ctest-vn2-vm1-13335895 is ready for SSH connections
2026-02-05 02:24:28,520 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-05 02:24:28,520 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 108.189.36.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-02-05 02:24:28,520 - DEBUG - ping -s 56 -c 3 -W 1 108.189.36.3
2026-02-05 02:24:32,594 - DEBUG - PING 108.189.36.3 (108.189.36.3): 56 data bytes
--- 108.189.36.3 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-02-05 02:24:32,594 - WARNING - Ping to IP 108.189.36.3 from VM ctest-vn1-vm1-29465033 failed
2026-02-05 02:24:32,594 - INFO - Adding interface with subnet_id 27cafac8-fb6f-4399-b715-dda441119fd8, port_id None to router 8e07fbb0-2645-488f-9d62-262d970cfa38
2026-02-05 02:24:33,024 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-05 02:24:33,024 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 108.189.36.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-02-05 02:24:33,024 - DEBUG - ping -s 56 -c 3 -W 1 108.189.36.3
2026-02-05 02:24:35,233 - DEBUG - PING 108.189.36.3 (108.189.36.3): 56 data bytes
64 bytes from 108.189.36.3: seq=0 ttl=63 time=5.110 ms
64 bytes from 108.189.36.3: seq=1 ttl=63 time=1.114 ms
64 bytes from 108.189.36.3: seq=2 ttl=63 time=1.036 ms
--- 108.189.36.3 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.036/2.420/5.110 ms
2026-02-05 02:24:35,233 - INFO - Ping to IP 108.189.36.3 from VM ctest-vn1-vm1-29465033 passed
2026-02-05 02:24:35,233 - INFO - Deleting interface with subnet_id a2e2866f-ea5f-4fe5-b77f-60ee0b05a316, port_id None from router 8e07fbb0-2645-488f-9d62-262d970cfa38
2026-02-05 02:24:35,485 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-05 02:24:35,485 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 108.189.36.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-02-05 02:24:35,485 - DEBUG - ping -s 56 -c 3 -W 1 108.189.36.3
2026-02-05 02:24:38,695 - DEBUG - PING 108.189.36.3 (108.189.36.3): 56 data bytes
--- 108.189.36.3 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-02-05 02:24:38,695 - WARNING - Ping to IP 108.189.36.3 from VM ctest-vn1-vm1-29465033 failed
2026-02-05 02:24:38,695 - INFO - Adding interface with subnet_id a2e2866f-ea5f-4fe5-b77f-60ee0b05a316, port_id None to router 8e07fbb0-2645-488f-9d62-262d970cfa38
2026-02-05 02:24:39,100 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-05 02:24:39,101 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 108.189.36.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-02-05 02:24:39,101 - DEBUG - ping -s 56 -c 3 -W 1 108.189.36.3
2026-02-05 02:24:41,316 - DEBUG - PING 108.189.36.3 (108.189.36.3): 56 data bytes
64 bytes from 108.189.36.3: seq=0 ttl=63 time=2.092 ms
64 bytes from 108.189.36.3: seq=1 ttl=63 time=1.055 ms
64 bytes from 108.189.36.3: seq=2 ttl=63 time=0.996 ms
--- 108.189.36.3 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.996/1.381/2.092 ms
2026-02-05 02:24:41,316 - INFO - Ping to IP 108.189.36.3 from VM ctest-vn1-vm1-29465033 passed
2026-02-05 02:24:41,317 - INFO - Deleting interface with subnet_id 27cafac8-fb6f-4399-b715-dda441119fd8, port_id None from router 8e07fbb0-2645-488f-9d62-262d970cfa38
2026-02-05 02:24:41,574 - INFO - Deleting interface with subnet_id a2e2866f-ea5f-4fe5-b77f-60ee0b05a316, port_id None from router 8e07fbb0-2645-488f-9d62-262d970cfa38
2026-02-05 02:24:41,915 - INFO - Deleting VM ctest-vn2-vm1-13335895
2026-02-05 02:24:42,015 - INFO - Deleting VM ctest-vn1-vm1-29465033
2026-02-05 02:24:42,111 - INFO - Deleting VN ctest-vn2-86793048
2026-02-05 02:24:42,153 - DEBUG - VN fa722311-7a0b-4f03-be79-a64a0fbdedf7 still in use: Unable to complete operation on network fa722311-7a0b-4f03-be79-a64a0fbdedf7. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-63aa2adb-6724-418d-8a37-319a17aac767']
2026-02-05 02:24:42,153 - WARNING - Deleting VN ctest-vn2-86793048 failed..Will retry
2026-02-05 02:24:44,319 - DEBUG - Response for deleting network ()
2026-02-05 02:24:44,319 - INFO - Deleting VN ctest-vn1-47827337
2026-02-05 02:24:44,508 - DEBUG - Response for deleting network ()
2026-02-05 02:24:45,821 - DEBUG - No XMPP flaps were noticed during the test
2026-02-05 02:24:45,821 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:44]
2026-02-05 02:24:45,821 - INFO - --------------------------------------------------------------------------------
2026-02-05 02:24:46,632 - INFO - Deleted project: ctest-TestRouters-24324101, ID : ccbae010-1683-4e4a-b9d0-449a5783e206