2026-01-22 02:14:15,808 - INFO - Domain Default found not creating
2026-01-22 02:14:16,031 - INFO - Project ctest-TestRouters-60510331 not found, creating it
2026-01-22 02:14:16,594 - INFO - Created Project:ctest-TestRouters-60510331, ID : 32e1223a-81a1-48f6-ba07-8698a41223cd
2026-01-22 02:14:18,170 - INFO - ================================================================================
2026-01-22 02:14:18,171 - INFO - STARTING TEST : test_basic_router_behavior
2026-01-22 02:14:18,171 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
Create a router
Create 2 VNs, and a VM in each
Add router port from each VN
Ping between VMs
2026-01-22 02:14:19,457 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.19': '0', '10.20.0.5': '0'}, '10.0.0.141': {'10.20.0.19': '0', '10.20.0.5': '0'}} with
2026-01-22 02:14:19,458 - INFO - Initial checks done. Running the testcase now
2026-01-22 02:14:19,458 - INFO -
2026-01-22 02:14:20,141 - DEBUG - Response for create_network : {'network': {'id': '94fe3ad3-2772-4811-ba4e-2128903a9456', 'name': 'ctest-vn1-95050687', 'tenant_id': '32e1223a81a148f6ba078698a41223cd', 'project_id': '32e1223a81a148f6ba078698a41223cd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-60510331', 'ctest-vn1-95050687'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 02:14:20,471 - DEBUG - Response for create_subnet : {'subnet': {'id': 'dcc7443a-bdf4-490e-95ee-fd94889f9f49', 'name': '', 'tenant_id': '32e1223a81a148f6ba078698a41223cd', 'network_id': '94fe3ad3-2772-4811-ba4e-2128903a9456', 'ip_version': 4, 'cidr': '218.39.169.0/26', 'allocation_pools': [{'start': '218.39.169.2', 'end': '218.39.169.62'}], 'gateway_ip': '218.39.169.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '218.39.169.2', 'tags': [], 'project_id': '32e1223a81a148f6ba078698a41223cd'}}
2026-01-22 02:14:20,497 - INFO - Created VN ctest-vn1-95050687
2026-01-22 02:14:20,515 - DEBUG - VN ctest-vn1-95050687 UUID is 94fe3ad3-2772-4811-ba4e-2128903a9456
2026-01-22 02:14:20,888 - DEBUG - Response for create_network : {'network': {'id': '765b0da3-874f-4b88-8ec2-bf9c61f89806', 'name': 'ctest-vn2-01463600', 'tenant_id': '32e1223a81a148f6ba078698a41223cd', 'project_id': '32e1223a81a148f6ba078698a41223cd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-60510331', 'ctest-vn2-01463600'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 02:14:21,146 - DEBUG - Response for create_subnet : {'subnet': {'id': 'afeaca8d-2c49-462e-bd4d-1de16c807bff', 'name': '', 'tenant_id': '32e1223a81a148f6ba078698a41223cd', 'network_id': '765b0da3-874f-4b88-8ec2-bf9c61f89806', 'ip_version': 4, 'cidr': '126.30.128.0/26', 'allocation_pools': [{'start': '126.30.128.2', 'end': '126.30.128.62'}], 'gateway_ip': '126.30.128.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '126.30.128.2', 'tags': [], 'project_id': '32e1223a81a148f6ba078698a41223cd'}}
2026-01-22 02:14:21,175 - INFO - Created VN ctest-vn2-01463600
2026-01-22 02:14:21,186 - DEBUG - VN ctest-vn2-01463600 UUID is 765b0da3-874f-4b88-8ec2-bf9c61f89806
2026-01-22 02:14:21,321 - DEBUG - Services list from nova: [, , , ]
2026-01-22 02:14:22,637 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-1)
2026-01-22 02:14:23,931 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-2)
2026-01-22 02:14:24,045 - INFO - Adding interface with subnet_id dcc7443a-bdf4-490e-95ee-fd94889f9f49, port_id None to router 2ba918d2-e582-432d-8d3c-c1793531dcfa
2026-01-22 02:14:24,519 - INFO - Waiting for VM ctest-vn1-vm1-51375125 to be up..
2026-01-22 02:14:24,674 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-01-22 02:14:29,815 - DEBUG - VM is in ACTIVE state now
2026-01-22 02:14:29,815 - INFO - VM name : ctest-vn1-vm1-51375125
2026-01-22 02:14:29,902 - DEBUG - VM ctest-vn1-vm1-51375125 ID is 07cedacd-497c-418b-83aa-42f76a3c4320
2026-01-22 02:14:29,927 - DEBUG - VM ctest-vn1-vm1-51375125 launched on Node an-jenkins-deploy-platform-ansible-os-5055-1
2026-01-22 02:14:30,019 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/07cedacd-497c-418b-83aa-42f76a3c4320
2026-01-22 02:14:30,329 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/07cedacd-497c-418b-83aa-42f76a3c4320
2026-01-22 02:14:30,373 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/34a11be2-3958-487d-a58f-91a159fabd79
2026-01-22 02:14:33,550 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2026-01-22 02:14:33,551 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-51375125 failed!
2026-01-22 02:14:33,563 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-60510331:ctest-vn1-95050687 is 218.39.169.1 and allocation pool is NOT set
2026-01-22 02:14:37,645 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=12.1 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1017ms\r\nrtt min/avg/max/mdev = 12.081/12.081/12.081/0.000 ms')
2026-01-22 02:14:37,646 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-51375125 passed
2026-01-22 02:14:37,716 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-22 02:14:37,717 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-51375125, IP 218.39.169.3, Port 22
2026-01-22 02:14:37,784 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-01-22 02:14:37,890 - DEBUG - VM ctest-vn1-vm1-51375125 is NOT ready for SSH connections, VM status: ACTIVE
2026-01-22 02:14:42,890 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-22 02:14:42,891 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-51375125, IP 218.39.169.3, Port 22
2026-01-22 02:14:43,057 - DEBUG - VM ctest-vn1-vm1-51375125 is ready for SSH connections
2026-01-22 02:14:43,057 - INFO - Waiting for VM ctest-vn2-vm1-35754717 to be up..
2026-01-22 02:14:43,139 - DEBUG - VM is in ACTIVE state now
2026-01-22 02:14:43,140 - INFO - VM name : ctest-vn2-vm1-35754717
2026-01-22 02:14:43,224 - DEBUG - VM ctest-vn2-vm1-35754717 ID is d976517e-0333-4c8c-a275-fc7c69236ec5
2026-01-22 02:14:43,224 - DEBUG - VM ctest-vn2-vm1-35754717 launched on Node an-jenkins-deploy-platform-ansible-os-5055-2
2026-01-22 02:14:43,313 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/d976517e-0333-4c8c-a275-fc7c69236ec5
2026-01-22 02:14:43,325 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/342d7b36-62cc-4a8d-8d6f-a8539504c3d7
2026-01-22 02:14:44,488 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.45 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.572 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.572/3.009/5.447/2.437 ms')
2026-01-22 02:14:44,488 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2-vm1-35754717 passed
2026-01-22 02:14:44,555 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-22 02:14:44,555 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-35754717, IP 126.30.128.3, Port 22
2026-01-22 02:14:44,721 - DEBUG - VM ctest-vn2-vm1-35754717 is ready for SSH connections
2026-01-22 02:14:44,721 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-22 02:14:44,721 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 126.30.128.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-01-22 02:14:44,721 - DEBUG - ping -s 56 -c 3 -W 1 126.30.128.3
2026-01-22 02:14:48,867 - DEBUG - PING 126.30.128.3 (126.30.128.3): 56 data bytes
--- 126.30.128.3 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-01-22 02:14:48,867 - WARNING - Ping to IP 126.30.128.3 from VM ctest-vn1-vm1-51375125 failed
2026-01-22 02:14:48,867 - INFO - Adding interface with subnet_id afeaca8d-2c49-462e-bd4d-1de16c807bff, port_id None to router 2ba918d2-e582-432d-8d3c-c1793531dcfa
2026-01-22 02:14:49,258 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-22 02:14:49,258 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 126.30.128.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-01-22 02:14:49,258 - DEBUG - ping -s 56 -c 3 -W 1 126.30.128.3
2026-01-22 02:14:52,493 - DEBUG - PING 126.30.128.3 (126.30.128.3): 56 data bytes
64 bytes from 126.30.128.3: seq=1 ttl=63 time=6.291 ms
64 bytes from 126.30.128.3: seq=2 ttl=63 time=1.443 ms
--- 126.30.128.3 ping statistics ---
3 packets transmitted, 2 packets received, 33% packet loss
round-trip min/avg/max = 1.443/3.867/6.291 ms
2026-01-22 02:14:52,493 - WARNING - Ping to IP 126.30.128.3 from VM ctest-vn1-vm1-51375125 failed
2026-01-22 02:14:53,495 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 126.30.128.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-01-22 02:14:53,495 - DEBUG - ping -s 56 -c 3 -W 1 126.30.128.3
2026-01-22 02:14:55,714 - DEBUG - PING 126.30.128.3 (126.30.128.3): 56 data bytes
64 bytes from 126.30.128.3: seq=0 ttl=63 time=9.885 ms
64 bytes from 126.30.128.3: seq=1 ttl=63 time=1.050 ms
64 bytes from 126.30.128.3: seq=2 ttl=63 time=1.037 ms
--- 126.30.128.3 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.037/3.990/9.885 ms
2026-01-22 02:14:55,715 - INFO - Ping to IP 126.30.128.3 from VM ctest-vn1-vm1-51375125 passed
2026-01-22 02:14:55,715 - INFO - Deleting interface with subnet_id dcc7443a-bdf4-490e-95ee-fd94889f9f49, port_id None from router 2ba918d2-e582-432d-8d3c-c1793531dcfa
2026-01-22 02:14:55,917 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-22 02:14:55,917 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 126.30.128.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-01-22 02:14:55,917 - DEBUG - ping -s 56 -c 3 -W 1 126.30.128.3
2026-01-22 02:14:59,136 - DEBUG - PING 126.30.128.3 (126.30.128.3): 56 data bytes
--- 126.30.128.3 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-01-22 02:14:59,136 - WARNING - Ping to IP 126.30.128.3 from VM ctest-vn1-vm1-51375125 failed
2026-01-22 02:14:59,136 - INFO - Adding interface with subnet_id dcc7443a-bdf4-490e-95ee-fd94889f9f49, port_id None to router 2ba918d2-e582-432d-8d3c-c1793531dcfa
2026-01-22 02:14:59,492 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-22 02:14:59,493 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 126.30.128.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-01-22 02:14:59,493 - DEBUG - ping -s 56 -c 3 -W 1 126.30.128.3
2026-01-22 02:15:01,724 - DEBUG - PING 126.30.128.3 (126.30.128.3): 56 data bytes
64 bytes from 126.30.128.3: seq=0 ttl=63 time=4.189 ms
64 bytes from 126.30.128.3: seq=1 ttl=63 time=1.214 ms
64 bytes from 126.30.128.3: seq=2 ttl=63 time=1.153 ms
--- 126.30.128.3 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.153/2.185/4.189 ms
2026-01-22 02:15:01,724 - INFO - Ping to IP 126.30.128.3 from VM ctest-vn1-vm1-51375125 passed
2026-01-22 02:15:01,724 - INFO - Deleting interface with subnet_id afeaca8d-2c49-462e-bd4d-1de16c807bff, port_id None from router 2ba918d2-e582-432d-8d3c-c1793531dcfa
2026-01-22 02:15:02,031 - INFO - Deleting interface with subnet_id dcc7443a-bdf4-490e-95ee-fd94889f9f49, port_id None from router 2ba918d2-e582-432d-8d3c-c1793531dcfa
2026-01-22 02:15:02,361 - INFO - Deleting VM ctest-vn2-vm1-35754717
2026-01-22 02:15:02,461 - INFO - Deleting VM ctest-vn1-vm1-51375125
2026-01-22 02:15:02,544 - INFO - Deleting VN ctest-vn2-01463600
2026-01-22 02:15:02,587 - DEBUG - VN 765b0da3-874f-4b88-8ec2-bf9c61f89806 still in use: Unable to complete operation on network 765b0da3-874f-4b88-8ec2-bf9c61f89806. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-355ad2c3-426d-49ef-ac9b-23eeea3693f1']
2026-01-22 02:15:02,588 - WARNING - Deleting VN ctest-vn2-01463600 failed..Will retry
2026-01-22 02:15:04,804 - DEBUG - Response for deleting network ()
2026-01-22 02:15:04,804 - INFO - Deleting VN ctest-vn1-95050687
2026-01-22 02:15:04,986 - DEBUG - Response for deleting network ()
2026-01-22 02:15:06,273 - DEBUG - No XMPP flaps were noticed during the test
2026-01-22 02:15:06,273 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:48]
2026-01-22 02:15:06,273 - INFO - --------------------------------------------------------------------------------
2026-01-22 02:15:07,054 - INFO - Deleted project: ctest-TestRouters-60510331, ID : 32e1223a-81a1-48f6-ba07-8698a41223cd