2026-05-14 02:10:19,035 - INFO - Reading existing Domain with UUID d251bbb1-a677-4b52-8c85-ab79c9809042
2026-05-14 02:10:19,046 - INFO - Using existing domain ['admin_domain'](d251bbb1-a677-4b52-8c85-ab79c9809042)
2026-05-14 02:10:19,276 - INFO - Project ctest-TestRouters-24019928 not found, creating it
2026-05-14 02:10:19,804 - INFO - Created Project:ctest-TestRouters-24019928, ID : b8d85992-b6f4-426c-a601-925f583b3044
2026-05-14 02:10:21,803 - INFO - ================================================================================
2026-05-14 02:10:21,803 - INFO - STARTING TEST : test_basic_router_behavior
2026-05-14 02:10:21,803 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
Create a router
Create 2 VNs, and a VM in each
Add router port from each VN
Ping between VMs
2026-05-14 02:10:22,219 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.0.0.241': '0'}} with
2026-05-14 02:10:22,219 - INFO - Initial checks done. Running the testcase now
2026-05-14 02:10:22,219 - INFO -
2026-05-14 02:10:23,111 - DEBUG - Response for create_network : {'network': {'id': '574b04be-48f2-4b7c-809e-d4d5ababed82', 'name': 'ctest-vn1-30919267', 'tenant_id': 'b8d85992b6f4426ca601925f583b3044', 'project_id': 'b8d85992b6f4426ca601925f583b3044', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['admin_domain', 'ctest-TestRouters-24019928', 'ctest-vn1-30919267'], 'port_security_enabled': True, 'description': '', 'created_at': None, 'updated_at': None}}
2026-05-14 02:10:23,324 - DEBUG - Response for create_subnet : {'subnet': {'id': '14a7141e-c44d-4c5d-ab05-4ddd0a697de5', 'name': '', 'tenant_id': 'b8d85992b6f4426ca601925f583b3044', 'network_id': '574b04be-48f2-4b7c-809e-d4d5ababed82', 'ip_version': 4, 'cidr': '70.247.14.128/26', 'allocation_pools': [{'start': '70.247.14.130', 'end': '70.247.14.190'}], 'gateway_ip': '70.247.14.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'created_at': '2026-05-14T02:10:23.225738', 'updated_at': '2026-05-14T02:10:23.225738', 'dns_server_address': '70.247.14.130', 'tags': [], 'project_id': 'b8d85992b6f4426ca601925f583b3044'}}
2026-05-14 02:10:23,388 - INFO - Created VN ctest-vn1-30919267
2026-05-14 02:10:23,446 - DEBUG - VN ctest-vn1-30919267 UUID is 574b04be-48f2-4b7c-809e-d4d5ababed82
2026-05-14 02:10:23,963 - DEBUG - Response for create_network : {'network': {'id': 'f6b322e3-e3d7-4e85-9272-2a45fd44444d', 'name': 'ctest-vn2-67753845', 'tenant_id': 'b8d85992b6f4426ca601925f583b3044', 'project_id': 'b8d85992b6f4426ca601925f583b3044', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['admin_domain', 'ctest-TestRouters-24019928', 'ctest-vn2-67753845'], 'port_security_enabled': True, 'description': '', 'created_at': None, 'updated_at': None}}
2026-05-14 02:10:24,235 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f4c26054-95db-462b-8b17-427a93ce4678', 'name': '', 'tenant_id': 'b8d85992b6f4426ca601925f583b3044', 'network_id': 'f6b322e3-e3d7-4e85-9272-2a45fd44444d', 'ip_version': 4, 'cidr': '3.135.76.64/26', 'allocation_pools': [{'start': '3.135.76.66', 'end': '3.135.76.126'}], 'gateway_ip': '3.135.76.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'created_at': '2026-05-14T02:10:24.115437', 'updated_at': '2026-05-14T02:10:24.115437', 'dns_server_address': '3.135.76.66', 'tags': [], 'project_id': 'b8d85992b6f4426ca601925f583b3044'}}
2026-05-14 02:10:24,301 - INFO - Created VN ctest-vn2-67753845
2026-05-14 02:10:24,358 - DEBUG - VN ctest-vn2-67753845 UUID is f6b322e3-e3d7-4e85-9272-2a45fd44444d
2026-05-14 02:10:24,644 - DEBUG - Services list from nova: [, , ]
2026-05-14 02:10:25,810 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-juju-os-703-1), Zone: (nova:cn-jenkins-deploy-platform-juju-os-703-1)
2026-05-14 02:10:27,204 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-juju-os-703-1), Zone: (nova:cn-jenkins-deploy-platform-juju-os-703-1)
2026-05-14 02:10:27,407 - INFO - Adding interface with subnet_id 14a7141e-c44d-4c5d-ab05-4ddd0a697de5, port_id None to router 424d1fb5-b71f-4b31-915d-5e22a885a7ae
2026-05-14 02:10:27,966 - INFO - Waiting for VM ctest-vn1-vm1-03366912 to be up..
2026-05-14 02:10:28,283 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-05-14 02:10:33,444 - DEBUG - VM is in ACTIVE state now
2026-05-14 02:10:33,445 - INFO - VM name : ctest-vn1-vm1-03366912
2026-05-14 02:10:33,599 - DEBUG - VM ctest-vn1-vm1-03366912 ID is d6044750-15c6-4d3a-8083-c373533213ce
2026-05-14 02:10:33,631 - DEBUG - VM ctest-vn1-vm1-03366912 launched on Node cn-jenkins-deploy-platform-juju-os-703-1
2026-05-14 02:10:33,795 - DEBUG - Requesting: https://10.0.0.241:8082/virtual-machine/d6044750-15c6-4d3a-8083-c373533213ce
2026-05-14 02:10:34,141 - DEBUG - Requesting: https://10.0.0.241:8082/virtual-machine/d6044750-15c6-4d3a-8083-c373533213ce
2026-05-14 02:10:34,231 - DEBUG - Requesting: https://10.0.0.241:8082/virtual-machine-interface/1caf8763-edfe-4dbe-a818-e659b614ca9f
2026-05-14 02:10:37,707 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2026-05-14 02:10:37,707 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-03366912 failed!
2026-05-14 02:10:37,766 - DEBUG - Gateway for vn admin_domain:ctest-TestRouters-24019928:ctest-vn1-30919267 is 70.247.14.129 and allocation pool is NOT set
2026-05-14 02:10:39,865 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=12.6 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.691 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.691/6.630/12.570/5.939 ms')
2026-05-14 02:10:39,865 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-03366912 passed
2026-05-14 02:10:40,038 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-14 02:10:40,038 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-03366912, IP 70.247.14.131, Port 22
2026-05-14 02:10:40,129 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-05-14 02:10:40,283 - DEBUG - VM ctest-vn1-vm1-03366912 is NOT ready for SSH connections, VM status: ACTIVE
2026-05-14 02:10:45,283 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-14 02:10:45,284 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-03366912, IP 70.247.14.131, Port 22
2026-05-14 02:10:45,509 - DEBUG - VM ctest-vn1-vm1-03366912 is ready for SSH connections
2026-05-14 02:10:45,509 - INFO - Waiting for VM ctest-vn2-vm1-23860036 to be up..
2026-05-14 02:10:45,818 - DEBUG - VM is in ACTIVE state now
2026-05-14 02:10:45,818 - INFO - VM name : ctest-vn2-vm1-23860036
2026-05-14 02:10:45,968 - DEBUG - VM ctest-vn2-vm1-23860036 ID is a044b51a-22e1-470c-bb65-b1ded7faa3f8
2026-05-14 02:10:45,968 - DEBUG - VM ctest-vn2-vm1-23860036 launched on Node cn-jenkins-deploy-platform-juju-os-703-1
2026-05-14 02:10:46,131 - DEBUG - Requesting: https://10.0.0.241:8082/virtual-machine/a044b51a-22e1-470c-bb65-b1ded7faa3f8
2026-05-14 02:10:46,188 - DEBUG - Requesting: https://10.0.0.241:8082/virtual-machine-interface/aea43099-3c0a-4334-b173-a25a17b63b47
2026-05-14 02:10:47,639 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.00 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.490 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.490/2.246/4.002/1.756 ms')
2026-05-14 02:10:47,639 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn2-vm1-23860036 passed
2026-05-14 02:10:47,794 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-14 02:10:47,794 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-23860036, IP 3.135.76.67, Port 22
2026-05-14 02:10:48,008 - DEBUG - VM ctest-vn2-vm1-23860036 is ready for SSH connections
2026-05-14 02:10:48,009 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-14 02:10:48,009 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 3.135.76.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-05-14 02:10:48,009 - DEBUG - ping -s 56 -c 3 -W 1 3.135.76.67
2026-05-14 02:10:52,716 - DEBUG - PING 3.135.76.67 (3.135.76.67): 56 data bytes
--- 3.135.76.67 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-05-14 02:10:52,716 - WARNING - Ping to IP 3.135.76.67 from VM ctest-vn1-vm1-03366912 failed
2026-05-14 02:10:52,716 - INFO - Adding interface with subnet_id f4c26054-95db-462b-8b17-427a93ce4678, port_id None to router 424d1fb5-b71f-4b31-915d-5e22a885a7ae
2026-05-14 02:10:53,119 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-14 02:10:53,119 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 3.135.76.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-05-14 02:10:53,119 - DEBUG - ping -s 56 -c 3 -W 1 3.135.76.67
2026-05-14 02:10:56,349 - DEBUG - PING 3.135.76.67 (3.135.76.67): 56 data bytes
64 bytes from 3.135.76.67: seq=1 ttl=63 time=3.409 ms
64 bytes from 3.135.76.67: seq=2 ttl=63 time=0.890 ms
--- 3.135.76.67 ping statistics ---
3 packets transmitted, 2 packets received, 33% packet loss
round-trip min/avg/max = 0.890/2.149/3.409 ms
2026-05-14 02:10:56,350 - WARNING - Ping to IP 3.135.76.67 from VM ctest-vn1-vm1-03366912 failed
2026-05-14 02:10:57,351 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 3.135.76.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-05-14 02:10:57,351 - DEBUG - ping -s 56 -c 3 -W 1 3.135.76.67
2026-05-14 02:10:59,567 - DEBUG - PING 3.135.76.67 (3.135.76.67): 56 data bytes
64 bytes from 3.135.76.67: seq=0 ttl=63 time=2.340 ms
64 bytes from 3.135.76.67: seq=1 ttl=63 time=1.041 ms
64 bytes from 3.135.76.67: seq=2 ttl=63 time=0.987 ms
--- 3.135.76.67 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.987/1.456/2.340 ms
2026-05-14 02:10:59,567 - INFO - Ping to IP 3.135.76.67 from VM ctest-vn1-vm1-03366912 passed
2026-05-14 02:10:59,567 - INFO - Deleting interface with subnet_id 14a7141e-c44d-4c5d-ab05-4ddd0a697de5, port_id None from router 424d1fb5-b71f-4b31-915d-5e22a885a7ae
2026-05-14 02:10:59,812 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-14 02:10:59,813 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 3.135.76.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-05-14 02:10:59,813 - DEBUG - ping -s 56 -c 3 -W 1 3.135.76.67
2026-05-14 02:11:03,038 - DEBUG - PING 3.135.76.67 (3.135.76.67): 56 data bytes
--- 3.135.76.67 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-05-14 02:11:03,038 - WARNING - Ping to IP 3.135.76.67 from VM ctest-vn1-vm1-03366912 failed
2026-05-14 02:11:03,039 - INFO - Adding interface with subnet_id 14a7141e-c44d-4c5d-ab05-4ddd0a697de5, port_id None to router 424d1fb5-b71f-4b31-915d-5e22a885a7ae
2026-05-14 02:11:03,426 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-14 02:11:03,426 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 3.135.76.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-05-14 02:11:03,427 - DEBUG - ping -s 56 -c 3 -W 1 3.135.76.67
2026-05-14 02:11:05,649 - DEBUG - PING 3.135.76.67 (3.135.76.67): 56 data bytes
64 bytes from 3.135.76.67: seq=0 ttl=63 time=1.911 ms
64 bytes from 3.135.76.67: seq=1 ttl=63 time=1.763 ms
64 bytes from 3.135.76.67: seq=2 ttl=63 time=1.029 ms
--- 3.135.76.67 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.029/1.567/1.911 ms
2026-05-14 02:11:05,649 - INFO - Ping to IP 3.135.76.67 from VM ctest-vn1-vm1-03366912 passed
2026-05-14 02:11:05,649 - INFO - Deleting interface with subnet_id f4c26054-95db-462b-8b17-427a93ce4678, port_id None from router 424d1fb5-b71f-4b31-915d-5e22a885a7ae
2026-05-14 02:11:05,884 - INFO - Deleting interface with subnet_id 14a7141e-c44d-4c5d-ab05-4ddd0a697de5, port_id None from router 424d1fb5-b71f-4b31-915d-5e22a885a7ae
2026-05-14 02:11:06,296 - INFO - Deleting VM ctest-vn2-vm1-23860036
2026-05-14 02:11:06,433 - INFO - Deleting VM ctest-vn1-vm1-03366912
2026-05-14 02:11:06,563 - INFO - Deleting VN ctest-vn2-67753845
2026-05-14 02:11:06,698 - DEBUG - VN f6b322e3-e3d7-4e85-9272-2a45fd44444d still in use: Unable to complete operation on network f6b322e3-e3d7-4e85-9272-2a45fd44444d. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-0aeb46e0-44e0-442e-9e63-4d6b27048d68']
2026-05-14 02:11:06,698 - WARNING - Deleting VN ctest-vn2-67753845 failed..Will retry
2026-05-14 02:11:08,867 - DEBUG - Response for deleting network ()
2026-05-14 02:11:08,867 - INFO - Deleting VN ctest-vn1-30919267
2026-05-14 02:11:09,062 - DEBUG - Response for deleting network ()
2026-05-14 02:11:09,455 - DEBUG - No XMPP flaps were noticed during the test
2026-05-14 02:11:09,456 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:48]
2026-05-14 02:11:09,456 - INFO - --------------------------------------------------------------------------------
2026-05-14 02:11:10,241 - INFO - Deleted project: ctest-TestRouters-24019928, ID : b8d85992-b6f4-426c-a601-925f583b3044