2026-06-08 02:32:56,829 - INFO - Domain Default found not creating
2026-06-08 02:32:56,984 - INFO - Project ctest-TestRouters-21250927 not found, creating it
2026-06-08 02:32:57,521 - INFO - Created Project:ctest-TestRouters-21250927, ID : 3bcd2eb6-ed81-495a-bbda-ca0744593104
2026-06-08 02:32:59,064 - INFO - ================================================================================
2026-06-08 02:32:59,065 - INFO - STARTING TEST : test_basic_router_behavior
2026-06-08 02:32:59,065 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
Create a router
Create 2 VNs, and a VM in each
Add router port from each VN
Ping between VMs
2026-06-08 02:33:00,363 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.193': '3', '10.20.0.25': '1'}, '10.0.0.240': {'10.20.0.129': '3', '10.20.0.25': '2'}} with
2026-06-08 02:33:00,363 - INFO - Initial checks done. Running the testcase now
2026-06-08 02:33:00,363 - INFO -
2026-06-08 02:33:01,142 - DEBUG - Response for create_network : {'network': {'id': '49ffc23a-c4f6-44c8-9bb4-d477c35de5c0', 'name': 'ctest-vn1-20119063', 'tenant_id': '3bcd2eb6ed81495abbdaca0744593104', 'project_id': '3bcd2eb6ed81495abbdaca0744593104', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-21250927', 'ctest-vn1-20119063'], 'port_security_enabled': True, 'description': ''}}
2026-06-08 02:33:01,488 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bf35fb96-12d3-4a23-b974-b8ec9c0a3e58', 'name': '', 'tenant_id': '3bcd2eb6ed81495abbdaca0744593104', 'network_id': '49ffc23a-c4f6-44c8-9bb4-d477c35de5c0', 'ip_version': 4, 'cidr': '220.213.95.64/26', 'allocation_pools': [{'start': '220.213.95.66', 'end': '220.213.95.126'}], 'gateway_ip': '220.213.95.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '220.213.95.66', 'tags': [], 'project_id': '3bcd2eb6ed81495abbdaca0744593104'}}
2026-06-08 02:33:01,534 - INFO - Created VN ctest-vn1-20119063
2026-06-08 02:33:01,549 - DEBUG - VN ctest-vn1-20119063 UUID is 49ffc23a-c4f6-44c8-9bb4-d477c35de5c0
2026-06-08 02:33:01,940 - DEBUG - Response for create_network : {'network': {'id': '5b5dee64-ee11-4cce-a1ba-248f75ee7e5a', 'name': 'ctest-vn2-33964491', 'tenant_id': '3bcd2eb6ed81495abbdaca0744593104', 'project_id': '3bcd2eb6ed81495abbdaca0744593104', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-21250927', 'ctest-vn2-33964491'], 'port_security_enabled': True, 'description': ''}}
2026-06-08 02:33:02,170 - DEBUG - Response for create_subnet : {'subnet': {'id': '1a4f0c75-0f33-499b-ad90-bc0ce3a961e1', 'name': '', 'tenant_id': '3bcd2eb6ed81495abbdaca0744593104', 'network_id': '5b5dee64-ee11-4cce-a1ba-248f75ee7e5a', 'ip_version': 4, 'cidr': '68.4.226.64/26', 'allocation_pools': [{'start': '68.4.226.66', 'end': '68.4.226.126'}], 'gateway_ip': '68.4.226.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '68.4.226.66', 'tags': [], 'project_id': '3bcd2eb6ed81495abbdaca0744593104'}}
2026-06-08 02:33:02,195 - INFO - Created VN ctest-vn2-33964491
2026-06-08 02:33:02,208 - DEBUG - VN ctest-vn2-33964491 UUID is 5b5dee64-ee11-4cce-a1ba-248f75ee7e5a
2026-06-08 02:33:02,371 - DEBUG - Services list from nova: [, , , ]
2026-06-08 02:33:03,449 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5901-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5901-2)
2026-06-08 02:33:04,835 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5901-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5901-1)
2026-06-08 02:33:04,990 - INFO - Adding interface with subnet_id bf35fb96-12d3-4a23-b974-b8ec9c0a3e58, port_id None to router c9d33f59-2dc5-4f03-9e16-80036d6d7b59
2026-06-08 02:33:05,415 - INFO - Waiting for VM ctest-vn1-vm1-01323798 to be up..
2026-06-08 02:33:05,561 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-06-08 02:33:10,643 - DEBUG - VM is in ACTIVE state now
2026-06-08 02:33:10,643 - INFO - VM name : ctest-vn1-vm1-01323798
2026-06-08 02:33:10,721 - DEBUG - VM ctest-vn1-vm1-01323798 ID is cb831422-5838-4a61-8574-7d793fbdfca0
2026-06-08 02:33:10,743 - DEBUG - VM ctest-vn1-vm1-01323798 launched on Node an-jenkins-deploy-platform-ansible-os-5901-2
2026-06-08 02:33:10,825 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/cb831422-5838-4a61-8574-7d793fbdfca0
2026-06-08 02:33:11,122 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/cb831422-5838-4a61-8574-7d793fbdfca0
2026-06-08 02:33:11,160 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/56d20b2d-89d2-4ef3-973e-199b605a6e64
2026-06-08 02:33:14,346 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms')
2026-06-08 02:33:14,347 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-01323798 failed!
2026-06-08 02:33:14,362 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-21250927:ctest-vn1-20119063 is 220.213.95.65 and allocation pool is NOT set
2026-06-08 02:33:16,429 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=14.9 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.51 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.507/8.714/14.922/6.207 ms')
2026-06-08 02:33:16,429 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-01323798 passed
2026-06-08 02:33:16,500 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 02:33:16,500 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-01323798, IP 220.213.95.67, Port 22
2026-06-08 02:33:16,567 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-08 02:33:16,649 - DEBUG - VM ctest-vn1-vm1-01323798 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-08 02:33:21,650 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 02:33:21,650 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-01323798, IP 220.213.95.67, Port 22
2026-06-08 02:33:21,808 - DEBUG - VM ctest-vn1-vm1-01323798 is ready for SSH connections
2026-06-08 02:33:21,809 - INFO - Waiting for VM ctest-vn2-vm1-02909279 to be up..
2026-06-08 02:33:21,900 - DEBUG - VM is in ACTIVE state now
2026-06-08 02:33:21,900 - INFO - VM name : ctest-vn2-vm1-02909279
2026-06-08 02:33:21,997 - DEBUG - VM ctest-vn2-vm1-02909279 ID is da78334f-3d06-4849-96a6-e35ce4063128
2026-06-08 02:33:21,997 - DEBUG - VM ctest-vn2-vm1-02909279 launched on Node an-jenkins-deploy-platform-ansible-os-5901-1
2026-06-08 02:33:22,128 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/da78334f-3d06-4849-96a6-e35ce4063128
2026-06-08 02:33:22,141 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/c3c5d400-65b7-4d0f-a244-5adf149a3a0e
2026-06-08 02:33:23,321 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.67 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.380 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.380/2.023/3.667/1.643 ms')
2026-06-08 02:33:23,321 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2-vm1-02909279 passed
2026-06-08 02:33:23,399 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 02:33:23,399 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-02909279, IP 68.4.226.67, Port 22
2026-06-08 02:33:23,566 - DEBUG - VM ctest-vn2-vm1-02909279 is ready for SSH connections
2026-06-08 02:33:23,566 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 02:33:23,566 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 68.4.226.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-06-08 02:33:23,567 - DEBUG - ping -s 56 -c 3 -W 1 68.4.226.67
2026-06-08 02:33:27,499 - DEBUG - PING 68.4.226.67 (68.4.226.67): 56 data bytes
--- 68.4.226.67 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-06-08 02:33:27,499 - WARNING - Ping to IP 68.4.226.67 from VM ctest-vn1-vm1-01323798 failed
2026-06-08 02:33:27,499 - INFO - Adding interface with subnet_id 1a4f0c75-0f33-499b-ad90-bc0ce3a961e1, port_id None to router c9d33f59-2dc5-4f03-9e16-80036d6d7b59
2026-06-08 02:33:27,888 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 02:33:27,889 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 68.4.226.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-06-08 02:33:27,889 - DEBUG - ping -s 56 -c 3 -W 1 68.4.226.67
2026-06-08 02:33:31,123 - DEBUG - PING 68.4.226.67 (68.4.226.67): 56 data bytes
64 bytes from 68.4.226.67: seq=1 ttl=63 time=5.586 ms
64 bytes from 68.4.226.67: seq=2 ttl=63 time=1.541 ms
--- 68.4.226.67 ping statistics ---
3 packets transmitted, 2 packets received, 33% packet loss
round-trip min/avg/max = 1.541/3.563/5.586 ms
2026-06-08 02:33:31,123 - WARNING - Ping to IP 68.4.226.67 from VM ctest-vn1-vm1-01323798 failed
2026-06-08 02:33:32,124 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 68.4.226.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-06-08 02:33:32,124 - DEBUG - ping -s 56 -c 3 -W 1 68.4.226.67
2026-06-08 02:33:34,324 - DEBUG - PING 68.4.226.67 (68.4.226.67): 56 data bytes
64 bytes from 68.4.226.67: seq=0 ttl=63 time=3.243 ms
64 bytes from 68.4.226.67: seq=1 ttl=63 time=1.272 ms
64 bytes from 68.4.226.67: seq=2 ttl=63 time=1.490 ms
--- 68.4.226.67 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.272/2.001/3.243 ms
2026-06-08 02:33:34,324 - INFO - Ping to IP 68.4.226.67 from VM ctest-vn1-vm1-01323798 passed
2026-06-08 02:33:34,324 - INFO - Deleting interface with subnet_id bf35fb96-12d3-4a23-b974-b8ec9c0a3e58, port_id None from router c9d33f59-2dc5-4f03-9e16-80036d6d7b59
2026-06-08 02:33:34,549 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 02:33:34,549 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 68.4.226.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-06-08 02:33:34,549 - DEBUG - ping -s 56 -c 3 -W 1 68.4.226.67
2026-06-08 02:33:37,747 - DEBUG - PING 68.4.226.67 (68.4.226.67): 56 data bytes
--- 68.4.226.67 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-06-08 02:33:37,747 - WARNING - Ping to IP 68.4.226.67 from VM ctest-vn1-vm1-01323798 failed
2026-06-08 02:33:37,747 - INFO - Adding interface with subnet_id bf35fb96-12d3-4a23-b974-b8ec9c0a3e58, port_id None to router c9d33f59-2dc5-4f03-9e16-80036d6d7b59
2026-06-08 02:33:38,185 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 02:33:38,185 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 68.4.226.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-06-08 02:33:38,186 - DEBUG - ping -s 56 -c 3 -W 1 68.4.226.67
2026-06-08 02:33:40,395 - DEBUG - PING 68.4.226.67 (68.4.226.67): 56 data bytes
64 bytes from 68.4.226.67: seq=0 ttl=63 time=3.067 ms
64 bytes from 68.4.226.67: seq=1 ttl=63 time=1.389 ms
64 bytes from 68.4.226.67: seq=2 ttl=63 time=1.295 ms
--- 68.4.226.67 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.295/1.917/3.067 ms
2026-06-08 02:33:40,395 - INFO - Ping to IP 68.4.226.67 from VM ctest-vn1-vm1-01323798 passed
2026-06-08 02:33:40,395 - INFO - Deleting interface with subnet_id 1a4f0c75-0f33-499b-ad90-bc0ce3a961e1, port_id None from router c9d33f59-2dc5-4f03-9e16-80036d6d7b59
2026-06-08 02:33:40,642 - INFO - Deleting interface with subnet_id bf35fb96-12d3-4a23-b974-b8ec9c0a3e58, port_id None from router c9d33f59-2dc5-4f03-9e16-80036d6d7b59
2026-06-08 02:33:40,946 - INFO - Deleting VM ctest-vn2-vm1-02909279
2026-06-08 02:33:41,044 - INFO - Deleting VM ctest-vn1-vm1-01323798
2026-06-08 02:33:41,122 - INFO - Deleting VN ctest-vn2-33964491
2026-06-08 02:33:41,172 - DEBUG - VN 5b5dee64-ee11-4cce-a1ba-248f75ee7e5a still in use: Unable to complete operation on network 5b5dee64-ee11-4cce-a1ba-248f75ee7e5a. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f8d429e4-231c-4a7c-8fc1-c8c26c9c8b75']
2026-06-08 02:33:41,172 - WARNING - Deleting VN ctest-vn2-33964491 failed..Will retry
2026-06-08 02:33:43,335 - DEBUG - Response for deleting network ()
2026-06-08 02:33:43,335 - INFO - Deleting VN ctest-vn1-20119063
2026-06-08 02:33:43,518 - DEBUG - Response for deleting network ()
2026-06-08 02:33:44,793 - DEBUG - No XMPP flaps were noticed during the test
2026-06-08 02:33:44,793 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:45]
2026-06-08 02:33:44,793 - INFO - --------------------------------------------------------------------------------
2026-06-08 02:33:45,626 - INFO - Deleted project: ctest-TestRouters-21250927, ID : 3bcd2eb6-ed81-495a-bbda-ca0744593104